2020-11-20T11:40:48.379 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T11:40:48.381 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/blogbench} --name pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi --block --archive /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306 --verbose --owner scheduled_pdonnell@teuthology --lock -- /tmp/teuthology-worker.1x8vqxsd.tmp 2020-11-20T11:40:48.420 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:40:48.487 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306 branch: wip-pdonnell-testing-20201120.053228 description: fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/blogbench} email: pdonnell@redhat.com first_in_suite: false job_id: '5640306' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20201120.053228 ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd objectstore: filestore osd op complaint time: 180 osd shutdown pgref assert: true osd sloppy crc: true osd_max_omap_entries_per_request: 10000 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-pdonnell-testing-20201120.053228 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb owner: scheduled_pdonnell@teuthology priority: 95 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - osd.2 - osd.5 - osd.8 - osd.11 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20201120.053228 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - suites/blogbench.sh teuthology_branch: master timestamp: 2020-11-20_08:39:42 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.6033 2020-11-20T11:40:48.488 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa; will attempt to use it 2020-11-20T11:40:48.488 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa/tasks 2020-11-20T11:40:48.489 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T11:40:48.490 INFO:teuthology.task.internal:Checking packages... 2020-11-20T11:40:48.510 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash 'b86e691bf191566922a8f08e2a5abf64fde8cfcb' 2020-11-20T11:40:48.510 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T11:40:48.511 INFO:teuthology.packaging:ref: None 2020-11-20T11:40:48.511 INFO:teuthology.packaging:tag: None 2020-11-20T11:40:48.511 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20201120.053228 2020-11-20T11:40:48.512 INFO:teuthology.packaging:sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:40:48.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20201120.053228 2020-11-20T11:40:48.675 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7397.gb86e691b 2020-11-20T11:40:48.675 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T11:40:48.683 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T11:40:48.683 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T11:40:48.778 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T11:40:48.779 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:40:48.830 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:40:58.841 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:41:08.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:18.875 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:28.889 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:38.904 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:48.927 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:58.943 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:08.961 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:18.982 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:28.998 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:39.033 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:49.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:59.068 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:09.086 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:19.100 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:29.128 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:39.146 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:43:49.162 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:43:59.180 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:09.204 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:19.220 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:29.238 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:39.257 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:49.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:59.290 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:45:09.318 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:19.336 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:29.362 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:39.378 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:49.394 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:59.412 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:09.429 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:19.440 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:29.457 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:39.473 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:46:49.493 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:46:59.510 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:47:09.539 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:47:19.560 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:47:29.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:47:39.601 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:47:49.616 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:47:59.632 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:09.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:19.674 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:29.692 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:39.710 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:49.734 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:59.750 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:09.766 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:19.783 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:29.799 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:39.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:49.833 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:49:59.853 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:09.870 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:19.890 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:29.910 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:39.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:49.955 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:59.975 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:09.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:20.012 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:30.031 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:40.055 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:50.070 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:52:00.088 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:10.106 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:20.125 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:30.153 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:52:40.174 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:50.211 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:00.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:10.246 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:20.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:30.270 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:40.288 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:50.307 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:00.325 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:54:10.342 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:20.357 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:30.381 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:40.423 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:54:50.442 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:55:00.452 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:10.464 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:20.482 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:30.503 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:40.517 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:55:50.541 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:56:00.559 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:56:10.574 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:56:20.591 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:56:30.618 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:56:40.629 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:56:50.646 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:00.693 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:10.720 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:20.740 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:30.760 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:40.788 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:50.814 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:00.834 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:10.854 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:20.869 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:30.885 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:58:40.910 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:58:50.941 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:59:00.957 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306'} 2020-11-20T11:59:00.982 DEBUG:teuthology.lock.ops:locked ubuntu@smithi160.front.sepia.ceph.com, ubuntu@smithi150.front.sepia.ceph.com, ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T11:59:01.062 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f21e61140d0>, signals=[15]) 2020-11-20T11:59:01.288 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.1 2020-11-20T11:59:01.298 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 8.1 2020-11-20T11:59:01.307 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.1 2020-11-20T11:59:01.697 INFO:teuthology.orchestra.console:Power off smithi150 2020-11-20T11:59:01.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:59:01.712 INFO:teuthology.orchestra.console:Power off smithi134 2020-11-20T11:59:01.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:59:01.726 INFO:teuthology.orchestra.console:Power off smithi160 2020-11-20T11:59:01.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T11:59:01.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:01.743 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:01.753 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:05.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:05.775 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:05.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:09.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:09.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:09.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:10.100 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2020-11-20T11:59:10.202 INFO:teuthology.orchestra.console:Power on smithi150 2020-11-20T11:59:10.202 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:59:10.225 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:13.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:14.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:14.210 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2020-11-20T11:59:14.233 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2020-11-20T11:59:14.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:14.312 INFO:teuthology.orchestra.console:Power on smithi134 2020-11-20T11:59:14.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:59:14.335 INFO:teuthology.orchestra.console:Power on smithi160 2020-11-20T11:59:14.335 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T11:59:14.347 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:14.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:18.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:18.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:18.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T11:59:18.603 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2020-11-20T11:59:18.612 INFO:teuthology.orchestra.console:Power on for smithi160 completed 2020-11-20T11:59:18.639 INFO:teuthology.orchestra.console:Power on for smithi150 completed 2020-11-20T11:59:18.705 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2020-11-20T11:59:18.713 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2020-11-20T11:59:18.740 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2020-11-20T12:01:50.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:01:59.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:05.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:05.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:08.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:14.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:14.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:17.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:23.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:23.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:26.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:32.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:32.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:35.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:41.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:41.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:44.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:50.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:50.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:53.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:59.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:02:59.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:03:08.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:03:25.308 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T12:03:25.309 INFO:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T12:03:45.421 INFO:teuthology.provision.fog.smithi134:Node is ready 2020-11-20T12:03:45.422 INFO:teuthology.orchestra.run.smithi134:> hostname 2020-11-20T12:03:45.442 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2020-11-20T12:03:45.443 INFO:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2020-11-20T12:03:45.498 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2020-11-20T12:03:45.498 INFO:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2020-11-20T12:03:45.643 INFO:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2020-11-20T12:03:45.673 INFO:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2020-11-20T12:03:45.742 INFO:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2020-11-20T12:03:45.810 INFO:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2020-11-20T12:03:45.877 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2020-11-20T12:03:45.878 DEBUG:teuthology.parallel:result is None 2020-11-20T12:04:05.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:05.769 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T12:04:05.770 INFO:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T12:04:06.072 INFO:teuthology.provision.fog.smithi150:Node is ready 2020-11-20T12:04:06.073 INFO:teuthology.orchestra.run.smithi150:> hostname 2020-11-20T12:04:06.088 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2020-11-20T12:04:06.088 INFO:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2020-11-20T12:04:06.142 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2020-11-20T12:04:06.143 INFO:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2020-11-20T12:04:06.245 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2020-11-20T12:04:06.272 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2020-11-20T12:04:06.339 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2020-11-20T12:04:06.406 INFO:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2020-11-20T12:04:06.473 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2020-11-20T12:04:06.473 DEBUG:teuthology.parallel:result is None 2020-11-20T12:04:14.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:14.914 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T12:04:14.915 INFO:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T12:04:15.198 INFO:teuthology.provision.fog.smithi160:Node is ready 2020-11-20T12:04:15.199 INFO:teuthology.orchestra.run.smithi160:> hostname 2020-11-20T12:04:15.213 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2020-11-20T12:04:15.213 INFO:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2020-11-20T12:04:15.267 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2020-11-20T12:04:15.268 INFO:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2020-11-20T12:04:15.382 INFO:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2020-11-20T12:04:15.410 INFO:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2020-11-20T12:04:15.477 INFO:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2020-11-20T12:04:15.544 INFO:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2020-11-20T12:04:15.610 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2020-11-20T12:04:15.611 DEBUG:teuthology.parallel:result is None 2020-11-20T12:04:15.753 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2020-11-20T12:04:15.754 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T12:04:15.772 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2020-11-20T12:04:15.772 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T12:04:15.786 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2020-11-20T12:04:15.786 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T12:04:15.802 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2020-11-20T12:04:15.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:04:15.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:15.869 INFO:teuthology.orchestra.run.smithi160:> true 2020-11-20T12:04:16.026 INFO:teuthology.orchestra.run.smithi160:> uname -m 2020-11-20T12:04:16.080 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2020-11-20T12:04:16.081 INFO:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2020-11-20T12:04:16.134 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Linux" 2020-11-20T12:04:16.134 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8 (Core)" 2020-11-20T12:04:16.134 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2020-11-20T12:04:16.135 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2020-11-20T12:04:16.135 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2020-11-20T12:04:16.135 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:04:16.135 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T12:04:16.136 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2020-11-20T12:04:16.136 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T12:04:16.136 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T12:04:16.136 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T12:04:16.137 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:04:16.137 INFO:teuthology.orchestra.run.smithi160.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T12:04:16.137 INFO:teuthology.orchestra.run.smithi160.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T12:04:16.137 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T12:04:16.137 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T12:04:16.138 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:04:16.139 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2020-11-20T12:04:16.155 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2020-11-20T12:04:16.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:04:16.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:16.225 INFO:teuthology.orchestra.run.smithi150:> true 2020-11-20T12:04:16.395 INFO:teuthology.orchestra.run.smithi150:> uname -m 2020-11-20T12:04:16.449 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2020-11-20T12:04:16.449 INFO:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2020-11-20T12:04:16.503 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Linux" 2020-11-20T12:04:16.503 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8 (Core)" 2020-11-20T12:04:16.503 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2020-11-20T12:04:16.503 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2020-11-20T12:04:16.504 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8" 2020-11-20T12:04:16.504 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:04:16.504 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T12:04:16.504 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2020-11-20T12:04:16.504 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T12:04:16.505 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T12:04:16.505 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T12:04:16.505 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:04:16.505 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T12:04:16.505 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T12:04:16.506 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T12:04:16.506 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T12:04:16.506 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:04:16.507 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2020-11-20T12:04:16.523 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2020-11-20T12:04:16.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:04:16.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:16.596 INFO:teuthology.orchestra.run.smithi134:> true 2020-11-20T12:04:16.759 INFO:teuthology.orchestra.run.smithi134:> uname -m 2020-11-20T12:04:16.813 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2020-11-20T12:04:16.814 INFO:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2020-11-20T12:04:16.867 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Linux" 2020-11-20T12:04:16.868 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8 (Core)" 2020-11-20T12:04:16.868 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2020-11-20T12:04:16.868 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2020-11-20T12:04:16.868 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2020-11-20T12:04:16.869 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:04:16.869 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T12:04:16.869 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2020-11-20T12:04:16.869 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T12:04:16.870 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T12:04:16.870 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T12:04:16.870 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:04:16.870 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T12:04:16.870 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T12:04:16.871 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T12:04:16.871 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T12:04:16.871 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:04:16.872 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2020-11-20T12:04:16.888 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-11-20T12:04:16.935 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjrILcL5WftXLETNFUYPOvzDBxAp68JMK03EIqB6yoOotl063OozgSk8rC871QEdhchwihKoxxqVQeXr60wlmAm5Cqh5Em3AxLCUQK+5ruPpFxcmPRnyAMutDbVGtPZymlzUFDmj3yjlanDvjehtp8BpFQF8oLwpffO1tNkEdqnF1hzQ3iJWJjbnKyVJSP61WapoZyOydNIgIjawMYe3I2AuaXyuJekQSBDufs5o61jgW9wO5Th7NGx6E4v9cqD/Tcpw/tX28nL6xREXhYEOSKpd7BvknayOl0TLIvo/bZnWbLO7r3e6RVJE4DtMojMEFCPufMAH/Ae4u4veIES0W0ZAI6Fdt70wyOuHQh9cIygXWW5TqwaVNaou2HGutqPqNyDqJRNYhvoqEnnMu+i2a06yKnqjtGLqYGtC9wqH0sEwhsNRPfR1Gmhw+r/k2m6OX2ZHew7rfRxcMZ4B075vdHr9ACQd9IQ0YjveyBmNAQEf1s9nKHYezg8L75/Lm1b1U= smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFQMGsQfTBZojVYLZMIqlbfnhE0snCxnCudGgIWaAqGRjyzfqDDaEWLillQ7kVsBR+z7TeF3PIXelX7J5pdd39Fx4gQ+FoznyGVVahFOc8s7rdusYGYh7uVoqppQBtMLB9GPF+ONEldqzQjg2LIOHIKy2sqFlmSR4BRJu767+zMwm7+GjkbyzzthHyOwgZzhFtuW+Hw69gWWtQbuWWOXH01trhR3rRKK5hmtRyAJGX/WMFN6Br8tnV3OG+bTZNhQHGZ3Jzk15S2i3Prp2nTHu2U+jAJASXghTciTgJk/pxx8EFUE+Es7XuhLVgo2vgpdR4wU4Qv1eRFHZpXfI7S4IfRkN0sZZGTbVwttXVspuFq4vsfr9yvHZV/tidmludIbUL/PP8Ueth+bZd/8UZe7MSJSFmeSzGq0fnjP3i7noZTwZVJVkW4Ukc+rY5mI48fHcN44kDwLmGHvimAeInxr0op6sv/Dt5ncZNeBT+d2EtC638MuZ/BuXh4pWUa3ZBGXM= smithi160.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo+TRHSYnEm+h6Ry340cUuh2DfBR5/7h+DjM5ECPn97djpQuw65WkBhercNn+/UPai0DANVsMR+P1JQdGe5lNEj0MRVzl6mQzg/fF/ps4sEUR5SKYsUODbqHzhlE874LPtsD8H2sIMs3SopWFunc/MpSABhjaVbC50xjxpzh9/a2rjYJ1vFETaP7B0pS2N2WwOIA3Y/RQWfMGEVJTGrahDaAkSa40mEBFu8D5Aw+0j8uVNxTUsla79YOJaxcWxkUob/4J+F21ptqEhHf7srkI+piPMfyJy7dU4jFFaAHHdT1fnwTiQWsN6n2HWjv84As2gg5WDlIWGI1J3IWecrBkw7iTYypvAatLfCkb6P/gQAf7HzYOpFDUFn0/ve1fXvHVZKHafy3PqYYgoBjYQtGzkgE5OF4CzsJFiq7+Y0WDEKO3j9HbPstLdBd8AnhYDpWyxflM5ldTiKNFTlJVYrvsWqDiRpcgdz1F73579DKKqW9iwFPN/HqXFCxOG7V7hf4M= 2020-11-20T12:04:16.936 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T12:04:16.993 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T12:04:16.999 INFO:teuthology.task.internal:Saving configuration 2020-11-20T12:04:17.016 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T12:04:17.024 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T12:04:17.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:59:00.962338', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDVZcMnDrukpJLhVneEMKu0FLv/8zSmVCmoevH/9cKNBlrAvUUXOecBiHSYVpKZw5n+WisymU9KN/BrpFElHSco=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi160.front.sepia.ceph.com'} 2020-11-20T12:04:17.058 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:59:00.962359', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAz8Dp+dFbo8STOB0uUSA3wXfT1tbhbr54poWpNOJo5LKa0OFio3Thlb9rJIDTXhGOU0x+D8vrWldzyZiLTosgE=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi150.front.sepia.ceph.com'} 2020-11-20T12:04:17.073 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 11:59:00.962374', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFFNXEC7WVAWDHeb7Lu7Rf71N5OhiqG9IXUlUqj6PiUQkSpyv7hIq9mxkqCaoKV5M9B2obyJMMJov8hx9MU0LlA=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi134.front.sepia.ceph.com'} 2020-11-20T12:04:17.074 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T12:04:17.084 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2020-11-20T12:04:17.084 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2020-11-20T12:04:17.085 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2020-11-20T12:04:17.085 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T12:04:17.167 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f21e60c1378>, signals=[15]) 2020-11-20T12:04:17.168 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T12:04:17.174 INFO:teuthology.task.internal:Opening connections... 2020-11-20T12:04:17.175 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:04:17.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:17.248 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:04:17.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:17.324 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:04:17.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:04:17.400 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T12:04:17.408 INFO:teuthology.orchestra.run.smithi160:> uname -m 2020-11-20T12:04:17.423 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2020-11-20T12:04:17.423 INFO:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2020-11-20T12:04:17.477 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Linux" 2020-11-20T12:04:17.477 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8 (Core)" 2020-11-20T12:04:17.478 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2020-11-20T12:04:17.478 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2020-11-20T12:04:17.478 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2020-11-20T12:04:17.478 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:04:17.479 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T12:04:17.479 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2020-11-20T12:04:17.479 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T12:04:17.479 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T12:04:17.479 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T12:04:17.480 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:04:17.480 INFO:teuthology.orchestra.run.smithi160.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T12:04:17.480 INFO:teuthology.orchestra.run.smithi160.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T12:04:17.480 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T12:04:17.480 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T12:04:17.481 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:04:17.481 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2020-11-20T12:04:17.497 INFO:teuthology.orchestra.run.smithi150:> uname -m 2020-11-20T12:04:17.512 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2020-11-20T12:04:17.513 INFO:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2020-11-20T12:04:17.566 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Linux" 2020-11-20T12:04:17.566 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8 (Core)" 2020-11-20T12:04:17.567 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2020-11-20T12:04:17.567 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2020-11-20T12:04:17.567 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8" 2020-11-20T12:04:17.567 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:04:17.567 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T12:04:17.568 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2020-11-20T12:04:17.568 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T12:04:17.569 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T12:04:17.569 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T12:04:17.569 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:04:17.570 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T12:04:17.570 INFO:teuthology.orchestra.run.smithi150.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T12:04:17.571 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T12:04:17.571 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T12:04:17.572 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:04:17.573 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2020-11-20T12:04:17.590 INFO:teuthology.orchestra.run.smithi134:> uname -m 2020-11-20T12:04:17.605 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2020-11-20T12:04:17.606 INFO:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2020-11-20T12:04:17.659 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Linux" 2020-11-20T12:04:17.660 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8 (Core)" 2020-11-20T12:04:17.660 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2020-11-20T12:04:17.661 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2020-11-20T12:04:17.661 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2020-11-20T12:04:17.662 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:04:17.662 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-11-20T12:04:17.662 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2020-11-20T12:04:17.663 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-11-20T12:04:17.663 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.centos.org/" 2020-11-20T12:04:17.663 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-11-20T12:04:17.664 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:04:17.664 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-11-20T12:04:17.664 INFO:teuthology.orchestra.run.smithi134.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-11-20T12:04:17.664 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-11-20T12:04:17.665 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-11-20T12:04:17.665 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:04:17.665 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2020-11-20T12:04:17.680 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T12:04:17.742 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T12:04:17.749 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T12:04:17.750 INFO:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2020-11-20T12:04:17.752 INFO:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2020-11-20T12:04:17.755 INFO:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2020-11-20T12:04:17.768 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T12:04:17.775 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T12:04:17.775 INFO:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2020-11-20T12:04:17.805 INFO:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2020-11-20T12:04:17.808 INFO:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2020-11-20T12:04:17.830 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T12:04:17.886 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T12:04:17.900 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'branch': 'testing'}} 2020-11-20T12:04:17.900 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2020-11-20T12:04:17.901 INFO:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2020-11-20T12:04:17.946 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS 2020-11-20T12:04:17.947 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:04:17.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2020-11-20T12:04:18.246 DEBUG:teuthology.task.kernel:sha1 for client.0 is ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9 2020-11-20T12:04:18.246 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9"... 2020-11-20T12:04:18.247 INFO:teuthology.orchestra.run.smithi160:> uname -r 2020-11-20T12:04:18.262 INFO:teuthology.orchestra.run.smithi160.stdout:4.18.0-193.28.1.el8_2.x86_64 2020-11-20T12:04:18.263 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-193.28.1.el8_2.x86_64 vs ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9 2020-11-20T12:04:18.264 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2020-11-20T12:04:18.267 INFO:teuthology.orchestra.run.smithi160:> sudo yum upgrade -y linux-firmware 2020-11-20T12:04:20.685 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-8 - AppStream 39 MB/s | 7.0 MB 00:00 2020-11-20T12:04:21.949 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-11-20T12:04:22.383 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-8 - Extras 87 kB/s | 5.5 kB 00:00 2020-11-20T12:04:22.868 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 19 MB/s | 8.3 MB 00:00 2020-11-20T12:04:24.698 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 4.8 MB/s | 23 kB 00:00 2020-11-20T12:04:25.791 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2020-11-20T12:04:25.792 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2020-11-20T12:04:25.793 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2020-11-20T12:04:25.908 INFO:teuthology.task.kernel:Downloading kernel ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9 on client.0... 2020-11-20T12:04:25.908 INFO:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2020-11-20T12:04:25.944 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS 2020-11-20T12:04:25.945 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:04:25.946 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9 2020-11-20T12:04:26.112 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9/centos/8/flavors/default/x86_64/ 2020-11-20T12:04:26.112 INFO:teuthology.orchestra.run.smithi160:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.10.0_rc2_ceph_gac4f7b07f403-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9/centos/8/flavors/default/x86_64/ --input-file=- 2020-11-20T12:04:26.115 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi160.front.sepia.ceph.com to complete... 2020-11-20T12:04:43.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20 12:04:43 URL:https://2.chacra.ceph.com/r/kernel/testing/ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9/centos/8/flavors/default/x86_64/kernel-5.10.0_rc2_ceph_gac4f7b07f403-1.x86_64.rpm [517054028/517054028] -> "/tmp/kernel.x86_64.rpm" [1] 2020-11-20T12:04:43.480 INFO:teuthology.orchestra.run.smithi160.stderr:FINISHED --2020-11-20 12:04:43-- 2020-11-20T12:04:43.481 INFO:teuthology.orchestra.run.smithi160.stderr:Total wall clock time: 17s 2020-11-20T12:04:43.481 INFO:teuthology.orchestra.run.smithi160.stderr:Downloaded: 1 files, 493M in 17s (28.9 MB/s) 2020-11-20T12:04:43.482 INFO:teuthology.task.kernel:Installing kernel ac4f7b07f4039e2bfae0b119fa6b4810d4eaa4d9 on client.0... 2020-11-20T12:04:43.483 INFO:teuthology.orchestra.run.smithi160:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2020-11-20T12:04:45.556 INFO:teuthology.orchestra.run.smithi160.stdout:Verifying... ######################################## 2020-11-20T12:04:46.023 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing... ######################################## 2020-11-20T12:04:46.097 INFO:teuthology.orchestra.run.smithi160.stdout:Updating / installing... 2020-11-20T12:05:24.755 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.10.0_rc2_ceph_gac4f7b07f403-1######################################## 2020-11-20T12:05:47.606 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2020-11-20T12:05:47.607 INFO:teuthology.orchestra.run.smithi160:> rpm -qlp /tmp/kernel.x86_64.rpm 2020-11-20T12:05:47.688 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/System.map-5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:47.688 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/config-5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:47.688 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/vmlinux-5.10.0-rc2-ceph-gac4f7b07f403.bz2 2020-11-20T12:05:47.689 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/vmlinuz-5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:47.689 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:47.689 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel 2020-11-20T12:05:47.689 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch 2020-11-20T12:05:47.690 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86 2020-11-20T12:05:47.690 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto 2020-11-20T12:05:47.690 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/blowfish-x86_64.ko 2020-11-20T12:05:47.690 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2020-11-20T12:05:47.690 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2020-11-20T12:05:47.691 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/camellia-x86_64.ko 2020-11-20T12:05:47.691 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2020-11-20T12:05:47.691 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2020-11-20T12:05:47.691 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/crc32-pclmul.ko 2020-11-20T12:05:47.692 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/crc32c-intel.ko 2020-11-20T12:05:47.692 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2020-11-20T12:05:47.692 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2020-11-20T12:05:47.692 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2020-11-20T12:05:47.692 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2020-11-20T12:05:47.693 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/serpent-avx2.ko 2020-11-20T12:05:47.693 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2020-11-20T12:05:47.693 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/sha1-ssse3.ko 2020-11-20T12:05:47.693 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/sha256-ssse3.ko 2020-11-20T12:05:47.693 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/sha512-ssse3.ko 2020-11-20T12:05:47.694 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2020-11-20T12:05:47.694 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2020-11-20T12:05:47.694 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/crypto/twofish-x86_64.ko 2020-11-20T12:05:47.694 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kernel 2020-11-20T12:05:47.694 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kernel/cpu 2020-11-20T12:05:47.695 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kernel/cpu/mce 2020-11-20T12:05:47.695 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2020-11-20T12:05:47.696 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kvm 2020-11-20T12:05:47.696 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kvm/kvm-amd.ko 2020-11-20T12:05:47.696 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kvm/kvm-intel.ko 2020-11-20T12:05:47.696 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/kvm/kvm.ko 2020-11-20T12:05:47.696 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/oprofile 2020-11-20T12:05:47.697 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/arch/x86/oprofile/oprofile.ko 2020-11-20T12:05:47.697 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto 2020-11-20T12:05:47.697 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/ansi_cprng.ko 2020-11-20T12:05:47.697 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/anubis.ko 2020-11-20T12:05:47.698 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/arc4.ko 2020-11-20T12:05:47.698 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/async_tx 2020-11-20T12:05:47.698 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/async_tx/async_memcpy.ko 2020-11-20T12:05:47.698 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/async_tx/async_pq.ko 2020-11-20T12:05:47.698 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/async_tx/async_raid6_recov.ko 2020-11-20T12:05:47.699 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/async_tx/async_tx.ko 2020-11-20T12:05:47.699 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/async_tx/async_xor.ko 2020-11-20T12:05:47.699 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/async_tx/raid6test.ko 2020-11-20T12:05:47.699 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/authenc.ko 2020-11-20T12:05:47.700 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/authencesn.ko 2020-11-20T12:05:47.700 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/blake2b_generic.ko 2020-11-20T12:05:47.700 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/blowfish_common.ko 2020-11-20T12:05:47.700 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/blowfish_generic.ko 2020-11-20T12:05:47.700 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/camellia_generic.ko 2020-11-20T12:05:47.701 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/cast5_generic.ko 2020-11-20T12:05:47.701 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/cast6_generic.ko 2020-11-20T12:05:47.701 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/cast_common.ko 2020-11-20T12:05:47.701 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/ccm.ko 2020-11-20T12:05:47.702 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/cmac.ko 2020-11-20T12:05:47.702 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/crc32_generic.ko 2020-11-20T12:05:47.702 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/crypto_engine.ko 2020-11-20T12:05:47.702 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/crypto_user.ko 2020-11-20T12:05:47.703 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/cts.ko 2020-11-20T12:05:47.703 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/des_generic.ko 2020-11-20T12:05:47.703 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/dh_generic.ko 2020-11-20T12:05:47.703 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/echainiv.ko 2020-11-20T12:05:47.703 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/essiv.ko 2020-11-20T12:05:47.704 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/fcrypt.ko 2020-11-20T12:05:47.704 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/khazad.ko 2020-11-20T12:05:47.704 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/lz4.ko 2020-11-20T12:05:47.704 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/lz4hc.ko 2020-11-20T12:05:47.704 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/md4.ko 2020-11-20T12:05:47.705 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/michael_mic.ko 2020-11-20T12:05:47.705 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/pcbc.ko 2020-11-20T12:05:47.705 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/pcrypt.ko 2020-11-20T12:05:47.706 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/rmd128.ko 2020-11-20T12:05:47.706 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/rmd160.ko 2020-11-20T12:05:47.707 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/rmd256.ko 2020-11-20T12:05:47.707 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/rmd320.ko 2020-11-20T12:05:47.707 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/salsa20_generic.ko 2020-11-20T12:05:47.707 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/seed.ko 2020-11-20T12:05:47.707 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/serpent_generic.ko 2020-11-20T12:05:47.708 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/sha512_generic.ko 2020-11-20T12:05:47.708 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/tcrypt.ko 2020-11-20T12:05:47.708 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/tea.ko 2020-11-20T12:05:47.708 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/tgr192.ko 2020-11-20T12:05:47.708 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/twofish_common.ko 2020-11-20T12:05:47.709 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/twofish_generic.ko 2020-11-20T12:05:47.709 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/vmac.ko 2020-11-20T12:05:47.709 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/wp512.ko 2020-11-20T12:05:47.709 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/xcbc.ko 2020-11-20T12:05:47.709 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/xor.ko 2020-11-20T12:05:47.710 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/crypto/xxhash_generic.ko 2020-11-20T12:05:47.710 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers 2020-11-20T12:05:47.710 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi 2020-11-20T12:05:47.710 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi/acpi_ipmi.ko 2020-11-20T12:05:47.711 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi/acpi_pad.ko 2020-11-20T12:05:47.711 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi/custom_method.ko 2020-11-20T12:05:47.711 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi/ec_sys.ko 2020-11-20T12:05:47.711 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi/sbs.ko 2020-11-20T12:05:47.711 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi/sbshc.ko 2020-11-20T12:05:47.712 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/acpi/video.ko 2020-11-20T12:05:47.712 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata 2020-11-20T12:05:47.712 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/acard-ahci.ko 2020-11-20T12:05:47.712 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/ahci_platform.ko 2020-11-20T12:05:47.712 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/ata_generic.ko 2020-11-20T12:05:47.713 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/libahci_platform.ko 2020-11-20T12:05:47.713 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_acpi.ko 2020-11-20T12:05:47.713 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_ali.ko 2020-11-20T12:05:47.713 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_amd.ko 2020-11-20T12:05:47.713 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_artop.ko 2020-11-20T12:05:47.714 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_atiixp.ko 2020-11-20T12:05:47.714 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_atp867x.ko 2020-11-20T12:05:47.714 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_cmd640.ko 2020-11-20T12:05:47.714 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_cmd64x.ko 2020-11-20T12:05:47.714 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_cypress.ko 2020-11-20T12:05:47.715 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_efar.ko 2020-11-20T12:05:47.715 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_hpt366.ko 2020-11-20T12:05:47.715 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_hpt37x.ko 2020-11-20T12:05:47.715 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_hpt3x2n.ko 2020-11-20T12:05:47.715 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_hpt3x3.ko 2020-11-20T12:05:47.716 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_it8213.ko 2020-11-20T12:05:47.716 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_it821x.ko 2020-11-20T12:05:47.717 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_jmicron.ko 2020-11-20T12:05:47.717 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_marvell.ko 2020-11-20T12:05:47.717 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_mpiix.ko 2020-11-20T12:05:47.717 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_netcell.ko 2020-11-20T12:05:47.717 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_ninja32.ko 2020-11-20T12:05:47.718 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_ns87410.ko 2020-11-20T12:05:47.718 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_ns87415.ko 2020-11-20T12:05:47.718 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_oldpiix.ko 2020-11-20T12:05:47.718 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_opti.ko 2020-11-20T12:05:47.718 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_optidma.ko 2020-11-20T12:05:47.719 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_pcmcia.ko 2020-11-20T12:05:47.719 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_pdc2027x.ko 2020-11-20T12:05:47.719 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_pdc202xx_old.ko 2020-11-20T12:05:47.719 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_piccolo.ko 2020-11-20T12:05:47.719 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_rdc.ko 2020-11-20T12:05:47.720 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_sch.ko 2020-11-20T12:05:47.720 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_serverworks.ko 2020-11-20T12:05:47.720 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_sil680.ko 2020-11-20T12:05:47.720 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_sis.ko 2020-11-20T12:05:47.720 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_sl82c105.ko 2020-11-20T12:05:47.721 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_triflex.ko 2020-11-20T12:05:47.721 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pata_via.ko 2020-11-20T12:05:47.721 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/pdc_adma.ko 2020-11-20T12:05:47.721 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_inic162x.ko 2020-11-20T12:05:47.721 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_mv.ko 2020-11-20T12:05:47.722 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_nv.ko 2020-11-20T12:05:47.722 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_promise.ko 2020-11-20T12:05:47.737 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_qstor.ko 2020-11-20T12:05:47.737 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_sil.ko 2020-11-20T12:05:47.738 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_sil24.ko 2020-11-20T12:05:47.738 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_sis.ko 2020-11-20T12:05:47.738 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_svw.ko 2020-11-20T12:05:47.738 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_sx4.ko 2020-11-20T12:05:47.738 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_uli.ko 2020-11-20T12:05:47.739 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_via.ko 2020-11-20T12:05:47.739 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ata/sata_vsc.ko 2020-11-20T12:05:47.739 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/auxdisplay 2020-11-20T12:05:47.739 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/auxdisplay/ks0108.ko 2020-11-20T12:05:47.739 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/base 2020-11-20T12:05:47.740 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/base/regmap 2020-11-20T12:05:47.740 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/base/regmap/regmap-i2c.ko 2020-11-20T12:05:47.740 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/bcma 2020-11-20T12:05:47.740 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/bcma/bcma.ko 2020-11-20T12:05:47.740 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block 2020-11-20T12:05:47.741 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/aoe 2020-11-20T12:05:47.741 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/aoe/aoe.ko 2020-11-20T12:05:47.741 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/brd.ko 2020-11-20T12:05:47.741 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/drbd 2020-11-20T12:05:47.741 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/drbd/drbd.ko 2020-11-20T12:05:47.742 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/floppy.ko 2020-11-20T12:05:47.742 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/loop.ko 2020-11-20T12:05:47.742 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/mtip32xx 2020-11-20T12:05:47.742 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/mtip32xx/mtip32xx.ko 2020-11-20T12:05:47.742 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/nbd.ko 2020-11-20T12:05:47.743 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/null_blk.ko 2020-11-20T12:05:47.743 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/pktcdvd.ko 2020-11-20T12:05:47.743 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/rbd.ko 2020-11-20T12:05:47.743 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/skd.ko 2020-11-20T12:05:47.743 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/sx8.ko 2020-11-20T12:05:47.744 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/umem.ko 2020-11-20T12:05:47.744 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/virtio_blk.ko 2020-11-20T12:05:47.744 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/xen-blkback 2020-11-20T12:05:47.744 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/xen-blkback/xen-blkback.ko 2020-11-20T12:05:47.744 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/xen-blkfront.ko 2020-11-20T12:05:47.745 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/zram 2020-11-20T12:05:47.745 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/block/zram/zram.ko 2020-11-20T12:05:47.745 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char 2020-11-20T12:05:47.745 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/hangcheck-timer.ko 2020-11-20T12:05:47.746 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/hw_random 2020-11-20T12:05:47.746 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/hw_random/amd-rng.ko 2020-11-20T12:05:47.746 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/hw_random/intel-rng.ko 2020-11-20T12:05:47.746 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/hw_random/timeriomem-rng.ko 2020-11-20T12:05:47.746 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/hw_random/via-rng.ko 2020-11-20T12:05:47.747 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/hw_random/virtio-rng.ko 2020-11-20T12:05:47.747 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ipmi 2020-11-20T12:05:47.747 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ipmi/ipmi_devintf.ko 2020-11-20T12:05:47.747 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2020-11-20T12:05:47.747 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2020-11-20T12:05:47.748 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ipmi/ipmi_si.ko 2020-11-20T12:05:47.748 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ipmi/ipmi_ssif.ko 2020-11-20T12:05:47.748 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2020-11-20T12:05:47.748 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/lp.ko 2020-11-20T12:05:47.748 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/mwave 2020-11-20T12:05:47.749 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/mwave/mwave.ko 2020-11-20T12:05:47.749 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/pcmcia 2020-11-20T12:05:47.749 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/pcmcia/cm4000_cs.ko 2020-11-20T12:05:47.749 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/pcmcia/cm4040_cs.ko 2020-11-20T12:05:47.749 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/ppdev.ko 2020-11-20T12:05:47.750 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tlclk.ko 2020-11-20T12:05:47.750 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tpm 2020-11-20T12:05:47.750 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tpm/tpm.ko 2020-11-20T12:05:47.751 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tpm/tpm_atmel.ko 2020-11-20T12:05:47.751 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tpm/tpm_infineon.ko 2020-11-20T12:05:47.751 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tpm/tpm_nsc.ko 2020-11-20T12:05:47.752 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tpm/tpm_tis.ko 2020-11-20T12:05:47.752 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/tpm/tpm_tis_core.ko 2020-11-20T12:05:47.752 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/uv_mmtimer.ko 2020-11-20T12:05:47.753 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/char/virtio_console.ko 2020-11-20T12:05:47.753 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/cpufreq 2020-11-20T12:05:47.753 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/cpufreq/acpi-cpufreq.ko 2020-11-20T12:05:47.754 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2020-11-20T12:05:47.754 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/cpufreq/p4-clockmod.ko 2020-11-20T12:05:47.754 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/cpufreq/pcc-cpufreq.ko 2020-11-20T12:05:47.755 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/cpufreq/powernow-k8.ko 2020-11-20T12:05:47.755 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/cpufreq/speedstep-lib.ko 2020-11-20T12:05:47.756 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto 2020-11-20T12:05:47.756 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/ccp 2020-11-20T12:05:47.756 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/ccp/ccp-crypto.ko 2020-11-20T12:05:47.757 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/ccp/ccp.ko 2020-11-20T12:05:47.757 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/padlock-aes.ko 2020-11-20T12:05:47.757 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/padlock-sha.ko 2020-11-20T12:05:47.758 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/qat 2020-11-20T12:05:47.758 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/qat/qat_common 2020-11-20T12:05:47.758 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2020-11-20T12:05:47.759 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/qat/qat_dh895xcc 2020-11-20T12:05:47.759 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2020-11-20T12:05:47.759 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/virtio 2020-11-20T12:05:47.760 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/crypto/virtio/virtio_crypto.ko 2020-11-20T12:05:47.760 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/dca 2020-11-20T12:05:47.761 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/dca/dca.ko 2020-11-20T12:05:47.761 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/devfreq 2020-11-20T12:05:47.761 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/devfreq/governor_simpleondemand.ko 2020-11-20T12:05:47.762 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/dma 2020-11-20T12:05:47.762 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/dma/dw 2020-11-20T12:05:47.762 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/dma/dw/dw_dmac.ko 2020-11-20T12:05:47.763 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/dma/ioat 2020-11-20T12:05:47.763 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/dma/ioat/ioatdma.ko 2020-11-20T12:05:47.763 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac 2020-11-20T12:05:47.764 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/amd64_edac_mod.ko 2020-11-20T12:05:47.764 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/e752x_edac.ko 2020-11-20T12:05:47.764 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/edac_mce_amd.ko 2020-11-20T12:05:47.765 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i3000_edac.ko 2020-11-20T12:05:47.765 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i3200_edac.ko 2020-11-20T12:05:47.765 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i5000_edac.ko 2020-11-20T12:05:47.766 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i5100_edac.ko 2020-11-20T12:05:47.766 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i5400_edac.ko 2020-11-20T12:05:47.767 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i7300_edac.ko 2020-11-20T12:05:47.767 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i7core_edac.ko 2020-11-20T12:05:47.768 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/i82975x_edac.ko 2020-11-20T12:05:47.768 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/ie31200_edac.ko 2020-11-20T12:05:47.769 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/sb_edac.ko 2020-11-20T12:05:47.769 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/edac/x38_edac.ko 2020-11-20T12:05:47.769 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/firmware 2020-11-20T12:05:47.770 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/firmware/edd.ko 2020-11-20T12:05:47.770 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/firmware/iscsi_ibft.ko 2020-11-20T12:05:47.771 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/gpio 2020-11-20T12:05:47.771 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/gpio/gpio-ich.ko 2020-11-20T12:05:47.771 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/gpio/gpio-viperboard.ko 2020-11-20T12:05:47.772 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid 2020-11-20T12:05:47.772 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-appleir.ko 2020-11-20T12:05:47.772 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-aureal.ko 2020-11-20T12:05:47.773 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-axff.ko 2020-11-20T12:05:47.773 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-dr.ko 2020-11-20T12:05:47.774 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-elecom.ko 2020-11-20T12:05:47.774 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-elo.ko 2020-11-20T12:05:47.774 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-emsff.ko 2020-11-20T12:05:47.775 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-gaff.ko 2020-11-20T12:05:47.775 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-gt683r.ko 2020-11-20T12:05:47.775 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-gyration.ko 2020-11-20T12:05:47.776 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-holtek-kbd.ko 2020-11-20T12:05:47.776 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-holtek-mouse.ko 2020-11-20T12:05:47.777 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-holtekff.ko 2020-11-20T12:05:47.777 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-hyperv.ko 2020-11-20T12:05:47.777 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-icade.ko 2020-11-20T12:05:47.778 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-keytouch.ko 2020-11-20T12:05:47.778 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-kye.ko 2020-11-20T12:05:47.778 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-lcpower.ko 2020-11-20T12:05:47.778 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-led.ko 2020-11-20T12:05:47.779 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-lenovo.ko 2020-11-20T12:05:47.779 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-logitech-dj.ko 2020-11-20T12:05:47.779 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-logitech-hidpp.ko 2020-11-20T12:05:47.779 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-multitouch.ko 2020-11-20T12:05:47.779 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-ortek.ko 2020-11-20T12:05:47.780 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-penmount.ko 2020-11-20T12:05:47.780 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-petalynx.ko 2020-11-20T12:05:47.780 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-picolcd.ko 2020-11-20T12:05:47.780 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-pl.ko 2020-11-20T12:05:47.780 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-plantronics.ko 2020-11-20T12:05:47.781 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-primax.ko 2020-11-20T12:05:47.781 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-rmi.ko 2020-11-20T12:05:47.781 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-arvo.ko 2020-11-20T12:05:47.781 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-common.ko 2020-11-20T12:05:47.781 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-isku.ko 2020-11-20T12:05:47.782 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-kone.ko 2020-11-20T12:05:47.782 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-koneplus.ko 2020-11-20T12:05:47.782 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-konepure.ko 2020-11-20T12:05:47.782 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-kovaplus.ko 2020-11-20T12:05:47.782 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-lua.ko 2020-11-20T12:05:47.783 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-pyra.ko 2020-11-20T12:05:47.783 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-ryos.ko 2020-11-20T12:05:47.783 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat-savu.ko 2020-11-20T12:05:47.783 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-roccat.ko 2020-11-20T12:05:47.783 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-saitek.ko 2020-11-20T12:05:47.784 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-samsung.ko 2020-11-20T12:05:47.784 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-sensor-hub.ko 2020-11-20T12:05:47.784 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-sjoy.ko 2020-11-20T12:05:47.784 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-sony.ko 2020-11-20T12:05:47.784 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-speedlink.ko 2020-11-20T12:05:47.785 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-steelseries.ko 2020-11-20T12:05:47.785 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-sunplus.ko 2020-11-20T12:05:47.785 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-tivo.ko 2020-11-20T12:05:47.785 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-tmff.ko 2020-11-20T12:05:47.785 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-topseed.ko 2020-11-20T12:05:47.786 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-twinhan.ko 2020-11-20T12:05:47.786 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-uclogic.ko 2020-11-20T12:05:47.786 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-waltop.ko 2020-11-20T12:05:47.786 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-wiimote.ko 2020-11-20T12:05:47.786 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-xinmo.ko 2020-11-20T12:05:47.787 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-zpff.ko 2020-11-20T12:05:47.787 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/hid-zydacron.ko 2020-11-20T12:05:47.787 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/i2c-hid 2020-11-20T12:05:47.787 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/i2c-hid/i2c-hid.ko 2020-11-20T12:05:47.787 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/uhid.ko 2020-11-20T12:05:47.788 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hid/wacom.ko 2020-11-20T12:05:47.788 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hv 2020-11-20T12:05:47.788 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hv/hv_balloon.ko 2020-11-20T12:05:47.788 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hv/hv_utils.ko 2020-11-20T12:05:47.788 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hv/hv_vmbus.ko 2020-11-20T12:05:47.789 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon 2020-11-20T12:05:47.789 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/abituguru.ko 2020-11-20T12:05:47.789 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/abituguru3.ko 2020-11-20T12:05:47.789 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/acpi_power_meter.ko 2020-11-20T12:05:47.789 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ad7414.ko 2020-11-20T12:05:47.790 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ad7418.ko 2020-11-20T12:05:47.790 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adc128d818.ko 2020-11-20T12:05:47.790 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adm1021.ko 2020-11-20T12:05:47.790 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adm1025.ko 2020-11-20T12:05:47.790 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adm1026.ko 2020-11-20T12:05:47.791 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adm1029.ko 2020-11-20T12:05:47.791 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adm1031.ko 2020-11-20T12:05:47.791 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adm9240.ko 2020-11-20T12:05:47.791 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ads7828.ko 2020-11-20T12:05:47.791 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adt7410.ko 2020-11-20T12:05:47.792 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adt7411.ko 2020-11-20T12:05:47.792 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adt7462.ko 2020-11-20T12:05:47.792 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adt7470.ko 2020-11-20T12:05:47.792 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adt7475.ko 2020-11-20T12:05:47.792 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/adt7x10.ko 2020-11-20T12:05:47.793 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/amc6821.ko 2020-11-20T12:05:47.793 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/applesmc.ko 2020-11-20T12:05:47.793 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/asb100.ko 2020-11-20T12:05:47.793 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/asc7621.ko 2020-11-20T12:05:47.793 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/asus_atk0110.ko 2020-11-20T12:05:47.794 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/atxp1.ko 2020-11-20T12:05:47.794 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/coretemp.ko 2020-11-20T12:05:47.794 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/dell-smm-hwmon.ko 2020-11-20T12:05:47.794 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/dme1737.ko 2020-11-20T12:05:47.794 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ds1621.ko 2020-11-20T12:05:47.795 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ds620.ko 2020-11-20T12:05:47.795 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/emc1403.ko 2020-11-20T12:05:47.795 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/emc6w201.ko 2020-11-20T12:05:47.795 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/f71805f.ko 2020-11-20T12:05:47.795 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/f71882fg.ko 2020-11-20T12:05:47.796 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/f75375s.ko 2020-11-20T12:05:47.796 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/fam15h_power.ko 2020-11-20T12:05:47.796 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/fschmd.ko 2020-11-20T12:05:47.796 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/g760a.ko 2020-11-20T12:05:47.796 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/g762.ko 2020-11-20T12:05:47.797 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/gl518sm.ko 2020-11-20T12:05:47.797 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/gl520sm.ko 2020-11-20T12:05:47.797 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/hwmon-vid.ko 2020-11-20T12:05:47.797 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/i5500_temp.ko 2020-11-20T12:05:47.797 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/i5k_amb.ko 2020-11-20T12:05:47.798 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ibmaem.ko 2020-11-20T12:05:47.798 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ibmpex.ko 2020-11-20T12:05:47.798 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ina209.ko 2020-11-20T12:05:47.798 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ina2xx.ko 2020-11-20T12:05:47.798 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/it87.ko 2020-11-20T12:05:47.799 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/k10temp.ko 2020-11-20T12:05:47.799 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/k8temp.ko 2020-11-20T12:05:47.799 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lineage-pem.ko 2020-11-20T12:05:47.799 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm63.ko 2020-11-20T12:05:47.799 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm73.ko 2020-11-20T12:05:47.799 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm75.ko 2020-11-20T12:05:47.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm77.ko 2020-11-20T12:05:47.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm78.ko 2020-11-20T12:05:47.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm80.ko 2020-11-20T12:05:47.800 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm83.ko 2020-11-20T12:05:47.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm85.ko 2020-11-20T12:05:47.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm87.ko 2020-11-20T12:05:47.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm90.ko 2020-11-20T12:05:47.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm92.ko 2020-11-20T12:05:47.801 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm93.ko 2020-11-20T12:05:47.802 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm95234.ko 2020-11-20T12:05:47.802 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm95241.ko 2020-11-20T12:05:47.802 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/lm95245.ko 2020-11-20T12:05:47.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ltc2945.ko 2020-11-20T12:05:47.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ltc4151.ko 2020-11-20T12:05:47.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ltc4215.ko 2020-11-20T12:05:47.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ltc4222.ko 2020-11-20T12:05:47.803 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ltc4245.ko 2020-11-20T12:05:47.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ltc4260.ko 2020-11-20T12:05:47.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ltc4261.ko 2020-11-20T12:05:47.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max16065.ko 2020-11-20T12:05:47.804 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max1619.ko 2020-11-20T12:05:47.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max1668.ko 2020-11-20T12:05:47.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max197.ko 2020-11-20T12:05:47.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max6639.ko 2020-11-20T12:05:47.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max6642.ko 2020-11-20T12:05:47.805 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max6650.ko 2020-11-20T12:05:47.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/max6697.ko 2020-11-20T12:05:47.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/mcp3021.ko 2020-11-20T12:05:47.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/nct6683.ko 2020-11-20T12:05:47.806 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/nct6775.ko 2020-11-20T12:05:47.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/nct7802.ko 2020-11-20T12:05:47.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/ntc_thermistor.ko 2020-11-20T12:05:47.807 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pc87360.ko 2020-11-20T12:05:47.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pc87427.ko 2020-11-20T12:05:47.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pcf8591.ko 2020-11-20T12:05:47.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus 2020-11-20T12:05:47.808 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/adm1275.ko 2020-11-20T12:05:47.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/lm25066.ko 2020-11-20T12:05:47.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/ltc2978.ko 2020-11-20T12:05:47.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/max16064.ko 2020-11-20T12:05:47.809 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/max34440.ko 2020-11-20T12:05:47.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/max8688.ko 2020-11-20T12:05:47.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/pmbus.ko 2020-11-20T12:05:47.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2020-11-20T12:05:47.810 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/tps40422.ko 2020-11-20T12:05:47.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/ucd9000.ko 2020-11-20T12:05:47.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/ucd9200.ko 2020-11-20T12:05:47.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/pmbus/zl6100.ko 2020-11-20T12:05:47.811 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/powr1220.ko 2020-11-20T12:05:47.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/sch5627.ko 2020-11-20T12:05:47.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/sch5636.ko 2020-11-20T12:05:47.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/sch56xx-common.ko 2020-11-20T12:05:47.812 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/sht15.ko 2020-11-20T12:05:47.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/sht21.ko 2020-11-20T12:05:47.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/shtc1.ko 2020-11-20T12:05:47.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/sis5595.ko 2020-11-20T12:05:47.813 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/smsc47b397.ko 2020-11-20T12:05:47.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/smsc47m1.ko 2020-11-20T12:05:47.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/smsc47m192.ko 2020-11-20T12:05:47.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/thmc50.ko 2020-11-20T12:05:47.814 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/tmp102.ko 2020-11-20T12:05:47.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/tmp103.ko 2020-11-20T12:05:47.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/tmp401.ko 2020-11-20T12:05:47.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/tmp421.ko 2020-11-20T12:05:47.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/via-cputemp.ko 2020-11-20T12:05:47.815 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/via686a.ko 2020-11-20T12:05:47.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/vt1211.ko 2020-11-20T12:05:47.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/vt8231.ko 2020-11-20T12:05:47.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83627ehf.ko 2020-11-20T12:05:47.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83627hf.ko 2020-11-20T12:05:47.816 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83781d.ko 2020-11-20T12:05:47.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83791d.ko 2020-11-20T12:05:47.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83792d.ko 2020-11-20T12:05:47.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83793.ko 2020-11-20T12:05:47.817 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83795.ko 2020-11-20T12:05:47.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83l785ts.ko 2020-11-20T12:05:47.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/hwmon/w83l786ng.ko 2020-11-20T12:05:47.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c 2020-11-20T12:05:47.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/algos 2020-11-20T12:05:47.818 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2020-11-20T12:05:47.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2020-11-20T12:05:47.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses 2020-11-20T12:05:47.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2020-11-20T12:05:47.819 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-amd756.ko 2020-11-20T12:05:47.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-amd8111.ko 2020-11-20T12:05:47.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-designware-core.ko 2020-11-20T12:05:47.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2020-11-20T12:05:47.820 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2020-11-20T12:05:47.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2020-11-20T12:05:47.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-i801.ko 2020-11-20T12:05:47.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-isch.ko 2020-11-20T12:05:47.821 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-ismt.ko 2020-11-20T12:05:47.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2020-11-20T12:05:47.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-nforce2.ko 2020-11-20T12:05:47.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-parport.ko 2020-11-20T12:05:47.822 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2020-11-20T12:05:47.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-piix4.ko 2020-11-20T12:05:47.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-scmi.ko 2020-11-20T12:05:47.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-simtec.ko 2020-11-20T12:05:47.823 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-sis96x.ko 2020-11-20T12:05:47.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2020-11-20T12:05:47.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-via.ko 2020-11-20T12:05:47.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-viapro.ko 2020-11-20T12:05:47.824 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/busses/i2c-viperboard.ko 2020-11-20T12:05:47.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/i2c-dev.ko 2020-11-20T12:05:47.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/i2c-mux.ko 2020-11-20T12:05:47.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/i2c-slave-eeprom.ko 2020-11-20T12:05:47.825 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/i2c-smbus.ko 2020-11-20T12:05:47.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/i2c/i2c-stub.ko 2020-11-20T12:05:47.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband 2020-11-20T12:05:47.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core 2020-11-20T12:05:47.826 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core/ib_cm.ko 2020-11-20T12:05:47.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core/ib_core.ko 2020-11-20T12:05:47.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core/ib_umad.ko 2020-11-20T12:05:47.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core/ib_uverbs.ko 2020-11-20T12:05:47.827 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core/iw_cm.ko 2020-11-20T12:05:47.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core/rdma_cm.ko 2020-11-20T12:05:47.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/core/rdma_ucm.ko 2020-11-20T12:05:47.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw 2020-11-20T12:05:47.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/cxgb4 2020-11-20T12:05:47.828 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2020-11-20T12:05:47.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/mlx4 2020-11-20T12:05:47.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2020-11-20T12:05:47.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/mlx5 2020-11-20T12:05:47.829 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2020-11-20T12:05:47.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/mthca 2020-11-20T12:05:47.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2020-11-20T12:05:47.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp 2020-11-20T12:05:47.830 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/ipoib 2020-11-20T12:05:47.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2020-11-20T12:05:47.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/iser 2020-11-20T12:05:47.831 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2020-11-20T12:05:47.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/isert 2020-11-20T12:05:47.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2020-11-20T12:05:47.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/srp 2020-11-20T12:05:47.832 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2020-11-20T12:05:47.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/srpt 2020-11-20T12:05:47.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2020-11-20T12:05:47.833 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input 2020-11-20T12:05:47.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/gameport 2020-11-20T12:05:47.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/gameport/emu10k1-gp.ko 2020-11-20T12:05:47.834 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/gameport/fm801-gp.ko 2020-11-20T12:05:47.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/gameport/gameport.ko 2020-11-20T12:05:47.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/gameport/lightning.ko 2020-11-20T12:05:47.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/gameport/ns558.ko 2020-11-20T12:05:47.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/input-polldev.ko 2020-11-20T12:05:47.835 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/joydev.ko 2020-11-20T12:05:47.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/keyboard 2020-11-20T12:05:47.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/keyboard/gpio_keys.ko 2020-11-20T12:05:47.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse 2020-11-20T12:05:47.836 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/appletouch.ko 2020-11-20T12:05:47.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/bcm5974.ko 2020-11-20T12:05:47.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/cyapatp.ko 2020-11-20T12:05:47.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/elan_i2c.ko 2020-11-20T12:05:47.837 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/sermouse.ko 2020-11-20T12:05:47.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/synaptics_i2c.ko 2020-11-20T12:05:47.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/synaptics_usb.ko 2020-11-20T12:05:47.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/mouse/vsxxxaa.ko 2020-11-20T12:05:47.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/rmi4 2020-11-20T12:05:47.838 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/rmi4/rmi_core.ko 2020-11-20T12:05:47.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/serio 2020-11-20T12:05:47.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/serio/altera_ps2.ko 2020-11-20T12:05:47.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/serio/arc_ps2.ko 2020-11-20T12:05:47.839 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/serio/hyperv-keyboard.ko 2020-11-20T12:05:47.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/serio/serio_raw.ko 2020-11-20T12:05:47.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/input/sparse-keymap.ko 2020-11-20T12:05:47.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/iommu 2020-11-20T12:05:47.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/iommu/amd 2020-11-20T12:05:47.840 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/iommu/amd/iommu_v2.ko 2020-11-20T12:05:47.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds 2020-11-20T12:05:47.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/leds-blinkm.ko 2020-11-20T12:05:47.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/leds-clevo-mail.ko 2020-11-20T12:05:47.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/leds-lm3530.ko 2020-11-20T12:05:47.841 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/leds-lp3944.ko 2020-11-20T12:05:47.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/leds-ss4200.ko 2020-11-20T12:05:47.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger 2020-11-20T12:05:47.842 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-audio.ko 2020-11-20T12:05:47.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2020-11-20T12:05:47.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-camera.ko 2020-11-20T12:05:47.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2020-11-20T12:05:47.843 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2020-11-20T12:05:47.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2020-11-20T12:05:47.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2020-11-20T12:05:47.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-timer.ko 2020-11-20T12:05:47.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/leds/trigger/ledtrig-transient.ko 2020-11-20T12:05:47.844 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md 2020-11-20T12:05:47.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/bcache 2020-11-20T12:05:47.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/bcache/bcache.ko 2020-11-20T12:05:47.845 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-bio-prison.ko 2020-11-20T12:05:47.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-cache-smq.ko 2020-11-20T12:05:47.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-cache.ko 2020-11-20T12:05:47.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-crypt.ko 2020-11-20T12:05:47.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-delay.ko 2020-11-20T12:05:47.846 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-flakey.ko 2020-11-20T12:05:47.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-log-userspace.ko 2020-11-20T12:05:47.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-multipath.ko 2020-11-20T12:05:47.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-queue-length.ko 2020-11-20T12:05:47.847 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-raid.ko 2020-11-20T12:05:47.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-round-robin.ko 2020-11-20T12:05:47.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-service-time.ko 2020-11-20T12:05:47.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-switch.ko 2020-11-20T12:05:47.848 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-thin-pool.ko 2020-11-20T12:05:47.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/dm-verity.ko 2020-11-20T12:05:47.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/faulty.ko 2020-11-20T12:05:47.849 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/linear.ko 2020-11-20T12:05:47.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/multipath.ko 2020-11-20T12:05:47.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/persistent-data 2020-11-20T12:05:47.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2020-11-20T12:05:47.850 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/raid0.ko 2020-11-20T12:05:47.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/raid1.ko 2020-11-20T12:05:47.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/raid10.ko 2020-11-20T12:05:47.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/md/raid456.ko 2020-11-20T12:05:47.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message 2020-11-20T12:05:47.851 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion 2020-11-20T12:05:47.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion/mptbase.ko 2020-11-20T12:05:47.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion/mptctl.ko 2020-11-20T12:05:47.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion/mptfc.ko 2020-11-20T12:05:47.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion/mptlan.ko 2020-11-20T12:05:47.852 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion/mptsas.ko 2020-11-20T12:05:47.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion/mptscsih.ko 2020-11-20T12:05:47.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/message/fusion/mptspi.ko 2020-11-20T12:05:47.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd 2020-11-20T12:05:47.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd/lpc_ich.ko 2020-11-20T12:05:47.853 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd/lpc_sch.ko 2020-11-20T12:05:47.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd/mfd-core.ko 2020-11-20T12:05:47.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd/sm501.ko 2020-11-20T12:05:47.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd/viperboard.ko 2020-11-20T12:05:47.854 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd/vx855.ko 2020-11-20T12:05:47.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/mfd/wl1273-core.ko 2020-11-20T12:05:47.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc 2020-11-20T12:05:47.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/altera-stapl 2020-11-20T12:05:47.855 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2020-11-20T12:05:47.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/apds9802als.ko 2020-11-20T12:05:47.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/apds990x.ko 2020-11-20T12:05:47.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/bh1770glc.ko 2020-11-20T12:05:47.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/cb710 2020-11-20T12:05:47.856 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/cb710/cb710.ko 2020-11-20T12:05:47.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/eeprom 2020-11-20T12:05:47.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/eeprom/at24.ko 2020-11-20T12:05:47.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/eeprom/eeprom.ko 2020-11-20T12:05:47.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2020-11-20T12:05:47.857 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/eeprom/max6875.ko 2020-11-20T12:05:47.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/enclosure.ko 2020-11-20T12:05:47.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/hpilo.ko 2020-11-20T12:05:47.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/isl29003.ko 2020-11-20T12:05:47.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/isl29020.ko 2020-11-20T12:05:47.858 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/lis3lv02d 2020-11-20T12:05:47.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2020-11-20T12:05:47.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2020-11-20T12:05:47.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/mei 2020-11-20T12:05:47.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/mei/mei-me.ko 2020-11-20T12:05:47.859 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/mei/mei-txe.ko 2020-11-20T12:05:47.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/mei/mei.ko 2020-11-20T12:05:47.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/pvpanic.ko 2020-11-20T12:05:47.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/sgi-gru 2020-11-20T12:05:47.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/sgi-gru/gru.ko 2020-11-20T12:05:47.860 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/sgi-xp 2020-11-20T12:05:47.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/sgi-xp/xp.ko 2020-11-20T12:05:47.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/sgi-xp/xpc.ko 2020-11-20T12:05:47.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/sgi-xp/xpnet.ko 2020-11-20T12:05:47.861 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/tifm_7xx1.ko 2020-11-20T12:05:47.862 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/tifm_core.ko 2020-11-20T12:05:47.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/tsl2550.ko 2020-11-20T12:05:47.863 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/vmw_balloon.ko 2020-11-20T12:05:47.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/vmw_vmci 2020-11-20T12:05:47.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2020-11-20T12:05:47.864 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net 2020-11-20T12:05:47.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/bonding 2020-11-20T12:05:47.865 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/bonding/bonding.ko 2020-11-20T12:05:47.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dsa 2020-11-20T12:05:47.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dsa/b53 2020-11-20T12:05:47.866 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dsa/b53/b53_common.ko 2020-11-20T12:05:47.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dsa/bcm-sf2.ko 2020-11-20T12:05:47.867 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dsa/mv88e6060.ko 2020-11-20T12:05:47.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dsa/mv88e6xxx 2020-11-20T12:05:47.868 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2020-11-20T12:05:47.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/dummy.ko 2020-11-20T12:05:47.869 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/eql.ko 2020-11-20T12:05:47.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet 2020-11-20T12:05:47.870 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/3com 2020-11-20T12:05:47.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2020-11-20T12:05:47.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2020-11-20T12:05:47.871 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/3com/3c59x.ko 2020-11-20T12:05:47.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/3com/typhoon.ko 2020-11-20T12:05:47.872 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/8390 2020-11-20T12:05:47.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/8390/8390.ko 2020-11-20T12:05:47.873 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2020-11-20T12:05:47.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2020-11-20T12:05:47.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2020-11-20T12:05:47.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/adaptec 2020-11-20T12:05:47.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/adaptec/starfire.ko 2020-11-20T12:05:47.874 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/agere 2020-11-20T12:05:47.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/agere/et131x.ko 2020-11-20T12:05:47.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/alteon 2020-11-20T12:05:47.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/alteon/acenic.ko 2020-11-20T12:05:47.875 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/altera 2020-11-20T12:05:47.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/altera/altera_tse.ko 2020-11-20T12:05:47.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/amd 2020-11-20T12:05:47.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/amd/amd8111e.ko 2020-11-20T12:05:47.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2020-11-20T12:05:47.876 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/amd/pcnet32.ko 2020-11-20T12:05:47.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros 2020-11-20T12:05:47.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/alx 2020-11-20T12:05:47.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2020-11-20T12:05:47.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/atl1c 2020-11-20T12:05:47.877 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2020-11-20T12:05:47.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/atl1e 2020-11-20T12:05:47.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2020-11-20T12:05:47.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/atlx 2020-11-20T12:05:47.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2020-11-20T12:05:47.878 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2020-11-20T12:05:47.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom 2020-11-20T12:05:47.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/b44.ko 2020-11-20T12:05:47.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2020-11-20T12:05:47.879 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/bnx2x 2020-11-20T12:05:47.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2020-11-20T12:05:47.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/cnic.ko 2020-11-20T12:05:47.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/genet 2020-11-20T12:05:47.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2020-11-20T12:05:47.880 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/broadcom/tg3.ko 2020-11-20T12:05:47.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/brocade 2020-11-20T12:05:47.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/brocade/bna 2020-11-20T12:05:47.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2020-11-20T12:05:47.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio 2020-11-20T12:05:47.881 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb 2020-11-20T12:05:47.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2020-11-20T12:05:47.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb3 2020-11-20T12:05:47.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2020-11-20T12:05:47.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb4 2020-11-20T12:05:47.882 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2020-11-20T12:05:47.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2020-11-20T12:05:47.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2020-11-20T12:05:47.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/libcxgb 2020-11-20T12:05:47.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2020-11-20T12:05:47.883 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/cisco 2020-11-20T12:05:47.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/cisco/enic 2020-11-20T12:05:47.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2020-11-20T12:05:47.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec 2020-11-20T12:05:47.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip 2020-11-20T12:05:47.884 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2020-11-20T12:05:47.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2020-11-20T12:05:47.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2020-11-20T12:05:47.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2020-11-20T12:05:47.885 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2020-11-20T12:05:47.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2020-11-20T12:05:47.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2020-11-20T12:05:47.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dlink 2020-11-20T12:05:47.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dlink/dl2k.ko 2020-11-20T12:05:47.886 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dlink/sundance.ko 2020-11-20T12:05:47.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/dnet.ko 2020-11-20T12:05:47.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/emulex 2020-11-20T12:05:47.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/emulex/benet 2020-11-20T12:05:47.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2020-11-20T12:05:47.887 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/ethoc.ko 2020-11-20T12:05:47.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/fealnx.ko 2020-11-20T12:05:47.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel 2020-11-20T12:05:47.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/e100.ko 2020-11-20T12:05:47.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/e1000 2020-11-20T12:05:47.888 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2020-11-20T12:05:47.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/e1000e 2020-11-20T12:05:47.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2020-11-20T12:05:47.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/fm10k 2020-11-20T12:05:47.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2020-11-20T12:05:47.889 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/i40e 2020-11-20T12:05:47.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2020-11-20T12:05:47.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/iavf 2020-11-20T12:05:47.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2020-11-20T12:05:47.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/igb 2020-11-20T12:05:47.890 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/igb/igb.ko 2020-11-20T12:05:47.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/igbvf 2020-11-20T12:05:47.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2020-11-20T12:05:47.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/ixgb 2020-11-20T12:05:47.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2020-11-20T12:05:47.891 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/ixgbe 2020-11-20T12:05:47.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2020-11-20T12:05:47.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/ixgbevf 2020-11-20T12:05:47.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2020-11-20T12:05:47.892 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/jme.ko 2020-11-20T12:05:47.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/marvell 2020-11-20T12:05:47.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2020-11-20T12:05:47.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/marvell/skge.ko 2020-11-20T12:05:47.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/marvell/sky2.ko 2020-11-20T12:05:47.893 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/mellanox 2020-11-20T12:05:47.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/mellanox/mlx4 2020-11-20T12:05:47.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2020-11-20T12:05:47.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2020-11-20T12:05:47.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/mellanox/mlx5 2020-11-20T12:05:47.894 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/mellanox/mlx5/core 2020-11-20T12:05:47.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2020-11-20T12:05:47.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/micrel 2020-11-20T12:05:47.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2020-11-20T12:05:47.895 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/myricom 2020-11-20T12:05:47.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/myricom/myri10ge 2020-11-20T12:05:47.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2020-11-20T12:05:47.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/natsemi 2020-11-20T12:05:47.896 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2020-11-20T12:05:47.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2020-11-20T12:05:47.905 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/neterion 2020-11-20T12:05:47.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/neterion/s2io.ko 2020-11-20T12:05:47.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/neterion/vxge 2020-11-20T12:05:47.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2020-11-20T12:05:47.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/nvidia 2020-11-20T12:05:47.906 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2020-11-20T12:05:47.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/packetengines 2020-11-20T12:05:47.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2020-11-20T12:05:47.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2020-11-20T12:05:47.907 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/qlogic 2020-11-20T12:05:47.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/qlogic/netxen 2020-11-20T12:05:47.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2020-11-20T12:05:47.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2020-11-20T12:05:47.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/qlogic/qlcnic 2020-11-20T12:05:47.908 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2020-11-20T12:05:47.910 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/rdc 2020-11-20T12:05:47.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/rdc/r6040.ko 2020-11-20T12:05:47.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/realtek 2020-11-20T12:05:47.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/realtek/8139cp.ko 2020-11-20T12:05:47.911 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/realtek/8139too.ko 2020-11-20T12:05:47.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/realtek/atp.ko 2020-11-20T12:05:47.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/realtek/r8169.ko 2020-11-20T12:05:47.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/rocker 2020-11-20T12:05:47.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/rocker/rocker.ko 2020-11-20T12:05:47.912 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sfc 2020-11-20T12:05:47.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sfc/sfc.ko 2020-11-20T12:05:47.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/silan 2020-11-20T12:05:47.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/silan/sc92031.ko 2020-11-20T12:05:47.913 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sis 2020-11-20T12:05:47.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sis/sis190.ko 2020-11-20T12:05:47.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sis/sis900.ko 2020-11-20T12:05:47.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/smsc 2020-11-20T12:05:47.914 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/smsc/epic100.ko 2020-11-20T12:05:47.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2020-11-20T12:05:47.915 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2020-11-20T12:05:47.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2020-11-20T12:05:47.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/stmicro 2020-11-20T12:05:47.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/stmicro/stmmac 2020-11-20T12:05:47.916 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2020-11-20T12:05:47.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2020-11-20T12:05:47.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sun 2020-11-20T12:05:47.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sun/cassini.ko 2020-11-20T12:05:47.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sun/niu.ko 2020-11-20T12:05:47.917 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sun/sungem.ko 2020-11-20T12:05:47.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/sun/sunhme.ko 2020-11-20T12:05:47.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/tehuti 2020-11-20T12:05:47.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2020-11-20T12:05:47.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/ti 2020-11-20T12:05:47.918 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/ti/tlan.ko 2020-11-20T12:05:47.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/via 2020-11-20T12:05:47.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/via/via-rhine.ko 2020-11-20T12:05:47.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/via/via-velocity.ko 2020-11-20T12:05:47.919 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/wiznet 2020-11-20T12:05:47.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/wiznet/w5100.ko 2020-11-20T12:05:47.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/wiznet/w5300.ko 2020-11-20T12:05:47.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/xircom 2020-11-20T12:05:47.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2020-11-20T12:05:47.920 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/geneve.ko 2020-11-20T12:05:47.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/hyperv 2020-11-20T12:05:47.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/hyperv/hv_netvsc.ko 2020-11-20T12:05:47.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ieee802154 2020-11-20T12:05:47.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ieee802154/fakelb.ko 2020-11-20T12:05:47.921 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ifb.ko 2020-11-20T12:05:47.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ipvlan 2020-11-20T12:05:47.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ipvlan/ipvlan.ko 2020-11-20T12:05:47.922 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/macvlan.ko 2020-11-20T12:05:47.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/macvtap.ko 2020-11-20T12:05:47.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/mdio 2020-11-20T12:05:47.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/mdio.ko 2020-11-20T12:05:47.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2020-11-20T12:05:47.923 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/mdio/mdio-bitbang.ko 2020-11-20T12:05:47.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/mii.ko 2020-11-20T12:05:47.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/net_failover.ko 2020-11-20T12:05:47.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/netconsole.ko 2020-11-20T12:05:47.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/nlmon.ko 2020-11-20T12:05:47.924 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/pcs 2020-11-20T12:05:47.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/pcs/pcs-xpcs.ko 2020-11-20T12:05:47.925 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy 2020-11-20T12:05:47.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/amd.ko 2020-11-20T12:05:47.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/bcm-phy-lib.ko 2020-11-20T12:05:47.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/bcm7xxx.ko 2020-11-20T12:05:47.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/bcm87xx.ko 2020-11-20T12:05:47.926 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/broadcom.ko 2020-11-20T12:05:47.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/cicada.ko 2020-11-20T12:05:47.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/davicom.ko 2020-11-20T12:05:47.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/dp83640.ko 2020-11-20T12:05:47.927 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/et1011c.ko 2020-11-20T12:05:47.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/icplus.ko 2020-11-20T12:05:47.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/lxt.ko 2020-11-20T12:05:47.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/marvell.ko 2020-11-20T12:05:47.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/micrel.ko 2020-11-20T12:05:47.928 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/national.ko 2020-11-20T12:05:47.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/phylink.ko 2020-11-20T12:05:47.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/qsemi.ko 2020-11-20T12:05:47.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/realtek.ko 2020-11-20T12:05:47.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/smsc.ko 2020-11-20T12:05:47.929 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/ste10Xp.ko 2020-11-20T12:05:47.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/phy/vitesse.ko 2020-11-20T12:05:47.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp 2020-11-20T12:05:47.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/bsd_comp.ko 2020-11-20T12:05:47.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/ppp_async.ko 2020-11-20T12:05:47.930 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/ppp_deflate.ko 2020-11-20T12:05:47.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/ppp_generic.ko 2020-11-20T12:05:47.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/ppp_mppe.ko 2020-11-20T12:05:47.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/ppp_synctty.ko 2020-11-20T12:05:47.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/pppoe.ko 2020-11-20T12:05:47.931 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/pppox.ko 2020-11-20T12:05:47.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/ppp/pptp.ko 2020-11-20T12:05:47.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/slip 2020-11-20T12:05:47.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/slip/slhc.ko 2020-11-20T12:05:47.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/slip/slip.ko 2020-11-20T12:05:47.932 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/sungem_phy.ko 2020-11-20T12:05:47.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/tap.ko 2020-11-20T12:05:47.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/team 2020-11-20T12:05:47.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/team/team.ko 2020-11-20T12:05:47.933 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/team/team_mode_activebackup.ko 2020-11-20T12:05:47.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/team/team_mode_broadcast.ko 2020-11-20T12:05:47.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/team/team_mode_loadbalance.ko 2020-11-20T12:05:47.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/team/team_mode_random.ko 2020-11-20T12:05:47.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/team/team_mode_roundrobin.ko 2020-11-20T12:05:47.934 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/tun.ko 2020-11-20T12:05:47.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/veth.ko 2020-11-20T12:05:47.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/virtio_net.ko 2020-11-20T12:05:47.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/vmxnet3 2020-11-20T12:05:47.935 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/vmxnet3/vmxnet3.ko 2020-11-20T12:05:47.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/vxlan.ko 2020-11-20T12:05:47.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/xen-netback 2020-11-20T12:05:47.936 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/xen-netback/xen-netback.ko 2020-11-20T12:05:47.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/net/xen-netfront.ko 2020-11-20T12:05:47.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ntb 2020-11-20T12:05:47.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ntb/ntb.ko 2020-11-20T12:05:47.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/nvme 2020-11-20T12:05:47.937 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/nvme/host 2020-11-20T12:05:47.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/nvme/host/nvme-core.ko 2020-11-20T12:05:47.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/nvme/host/nvme.ko 2020-11-20T12:05:47.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/parport 2020-11-20T12:05:47.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/parport/parport.ko 2020-11-20T12:05:47.938 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/parport/parport_cs.ko 2020-11-20T12:05:47.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/parport/parport_pc.ko 2020-11-20T12:05:47.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/parport/parport_serial.ko 2020-11-20T12:05:47.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pci 2020-11-20T12:05:47.939 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pci/hotplug 2020-11-20T12:05:47.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2020-11-20T12:05:47.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pci/pcie 2020-11-20T12:05:47.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pci/pcie/aer_inject.ko 2020-11-20T12:05:47.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pci/xen-pcifront.ko 2020-11-20T12:05:47.940 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pcmcia 2020-11-20T12:05:47.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pcmcia/i82092.ko 2020-11-20T12:05:47.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pcmcia/pd6729.ko 2020-11-20T12:05:47.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pcmcia/yenta_socket.ko 2020-11-20T12:05:47.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pinctrl 2020-11-20T12:05:47.941 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pinctrl/intel 2020-11-20T12:05:47.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2020-11-20T12:05:47.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform 2020-11-20T12:05:47.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86 2020-11-20T12:05:47.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/acer-wmi.ko 2020-11-20T12:05:47.942 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/acerhdf.ko 2020-11-20T12:05:47.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/alienware-wmi.ko 2020-11-20T12:05:47.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/apple-gmux.ko 2020-11-20T12:05:47.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/asus-laptop.ko 2020-11-20T12:05:47.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/asus-nb-wmi.ko 2020-11-20T12:05:47.943 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/asus-wmi.ko 2020-11-20T12:05:47.944 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/classmate-laptop.ko 2020-11-20T12:05:47.944 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/dcdbas.ko 2020-11-20T12:05:47.945 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/dell-smo8800.ko 2020-11-20T12:05:47.945 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/dell-wmi-aio.ko 2020-11-20T12:05:47.945 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/eeepc-laptop.ko 2020-11-20T12:05:47.946 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/eeepc-wmi.ko 2020-11-20T12:05:47.947 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/fujitsu-laptop.ko 2020-11-20T12:05:47.947 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/fujitsu-tablet.ko 2020-11-20T12:05:47.948 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/hdaps.ko 2020-11-20T12:05:47.948 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/hp-wireless.ko 2020-11-20T12:05:47.948 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/hp-wmi.ko 2020-11-20T12:05:47.949 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/hp_accel.ko 2020-11-20T12:05:47.949 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/intel-rst.ko 2020-11-20T12:05:47.949 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/intel_ips.ko 2020-11-20T12:05:47.950 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/msi-wmi.ko 2020-11-20T12:05:47.950 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/mxm-wmi.ko 2020-11-20T12:05:47.950 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/panasonic-laptop.ko 2020-11-20T12:05:47.951 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/samsung-laptop.ko 2020-11-20T12:05:47.951 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/samsung-q10.ko 2020-11-20T12:05:47.951 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/thinkpad_acpi.ko 2020-11-20T12:05:47.952 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/topstar-laptop.ko 2020-11-20T12:05:47.952 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2020-11-20T12:05:47.952 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/toshiba_haps.ko 2020-11-20T12:05:47.952 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/wmi-bmof.ko 2020-11-20T12:05:47.953 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/platform/x86/wmi.ko 2020-11-20T12:05:47.953 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/power 2020-11-20T12:05:47.953 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/power/supply 2020-11-20T12:05:47.953 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/power/supply/smb347-charger.ko 2020-11-20T12:05:47.953 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/powercap 2020-11-20T12:05:47.954 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/powercap/intel_rapl_common.ko 2020-11-20T12:05:47.954 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/powercap/intel_rapl_msr.ko 2020-11-20T12:05:47.954 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pps 2020-11-20T12:05:47.954 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pps/clients 2020-11-20T12:05:47.954 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pps/clients/pps-gpio.ko 2020-11-20T12:05:47.955 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pps/clients/pps-ldisc.ko 2020-11-20T12:05:47.955 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pps/clients/pps_parport.ko 2020-11-20T12:05:47.955 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/pps/pps_core.ko 2020-11-20T12:05:47.955 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ptp 2020-11-20T12:05:47.955 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ptp/ptp.ko 2020-11-20T12:05:47.956 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ptp/ptp_kvm.ko 2020-11-20T12:05:47.956 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc 2020-11-20T12:05:47.956 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-bq32k.ko 2020-11-20T12:05:47.956 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-bq4802.ko 2020-11-20T12:05:47.957 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds1286.ko 2020-11-20T12:05:47.957 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds1307.ko 2020-11-20T12:05:47.957 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds1374.ko 2020-11-20T12:05:47.958 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds1511.ko 2020-11-20T12:05:47.958 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds1553.ko 2020-11-20T12:05:47.958 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds1672.ko 2020-11-20T12:05:47.958 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds1742.ko 2020-11-20T12:05:47.959 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds2404.ko 2020-11-20T12:05:47.959 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-ds3232.ko 2020-11-20T12:05:47.959 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-em3027.ko 2020-11-20T12:05:47.959 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-fm3130.ko 2020-11-20T12:05:47.959 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-isl12022.ko 2020-11-20T12:05:47.960 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-isl1208.ko 2020-11-20T12:05:47.960 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-m41t80.ko 2020-11-20T12:05:47.960 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-m48t35.ko 2020-11-20T12:05:47.960 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-m48t59.ko 2020-11-20T12:05:47.960 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-max6900.ko 2020-11-20T12:05:47.961 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-msm6242.ko 2020-11-20T12:05:47.961 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-pcf2127.ko 2020-11-20T12:05:47.961 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-pcf85063.ko 2020-11-20T12:05:47.961 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-pcf8523.ko 2020-11-20T12:05:47.961 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-pcf8563.ko 2020-11-20T12:05:47.962 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-pcf8583.ko 2020-11-20T12:05:47.962 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-rp5c01.ko 2020-11-20T12:05:47.962 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-rs5c372.ko 2020-11-20T12:05:47.962 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-rv3029c2.ko 2020-11-20T12:05:47.962 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-rx8025.ko 2020-11-20T12:05:47.963 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-rx8581.ko 2020-11-20T12:05:47.963 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-stk17ta8.ko 2020-11-20T12:05:47.963 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-v3020.ko 2020-11-20T12:05:47.963 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/rtc/rtc-x1205.ko 2020-11-20T12:05:47.963 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi 2020-11-20T12:05:47.964 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/3w-9xxx.ko 2020-11-20T12:05:47.964 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/3w-sas.ko 2020-11-20T12:05:47.964 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/3w-xxxx.ko 2020-11-20T12:05:47.964 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/BusLogic.ko 2020-11-20T12:05:47.964 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/a100u2w.ko 2020-11-20T12:05:47.965 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/aacraid 2020-11-20T12:05:47.965 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/aacraid/aacraid.ko 2020-11-20T12:05:47.965 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/advansys.ko 2020-11-20T12:05:47.965 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/aic7xxx 2020-11-20T12:05:47.966 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2020-11-20T12:05:47.966 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2020-11-20T12:05:47.966 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/am53c974.ko 2020-11-20T12:05:47.966 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/arcmsr 2020-11-20T12:05:47.967 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/arcmsr/arcmsr.ko 2020-11-20T12:05:47.967 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/atp870u.ko 2020-11-20T12:05:47.967 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/be2iscsi 2020-11-20T12:05:47.967 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2020-11-20T12:05:47.967 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/bfa 2020-11-20T12:05:47.968 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/bfa/bfa.ko 2020-11-20T12:05:47.968 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/bnx2fc 2020-11-20T12:05:47.968 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2020-11-20T12:05:47.968 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/bnx2i 2020-11-20T12:05:47.969 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/bnx2i/bnx2i.ko 2020-11-20T12:05:47.969 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/ch.ko 2020-11-20T12:05:47.969 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/csiostor 2020-11-20T12:05:47.970 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/csiostor/csiostor.ko 2020-11-20T12:05:47.970 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/cxgbi 2020-11-20T12:05:47.970 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/cxgbi/cxgb3i 2020-11-20T12:05:47.970 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2020-11-20T12:05:47.971 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/cxgbi/cxgb4i 2020-11-20T12:05:47.971 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2020-11-20T12:05:47.971 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2020-11-20T12:05:47.971 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/dc395x.ko 2020-11-20T12:05:47.971 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/device_handler 2020-11-20T12:05:47.972 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2020-11-20T12:05:47.972 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2020-11-20T12:05:47.972 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2020-11-20T12:05:47.972 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2020-11-20T12:05:47.973 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/dmx3191d.ko 2020-11-20T12:05:47.973 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/esas2r 2020-11-20T12:05:47.973 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/esas2r/esas2r.ko 2020-11-20T12:05:47.973 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/esp_scsi.ko 2020-11-20T12:05:47.974 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/fcoe 2020-11-20T12:05:47.974 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/fcoe/fcoe.ko 2020-11-20T12:05:47.974 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/fcoe/libfcoe.ko 2020-11-20T12:05:47.974 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/fnic 2020-11-20T12:05:47.974 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/fnic/fnic.ko 2020-11-20T12:05:47.975 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/gdth.ko 2020-11-20T12:05:47.975 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/hpsa.ko 2020-11-20T12:05:47.975 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/hptiop.ko 2020-11-20T12:05:47.975 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/hv_storvsc.ko 2020-11-20T12:05:47.975 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/initio.ko 2020-11-20T12:05:47.976 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/ipr.ko 2020-11-20T12:05:47.976 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/ips.ko 2020-11-20T12:05:47.976 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/isci 2020-11-20T12:05:47.976 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/isci/isci.ko 2020-11-20T12:05:47.977 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2020-11-20T12:05:47.977 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/iscsi_tcp.ko 2020-11-20T12:05:47.977 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/libfc 2020-11-20T12:05:47.977 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/libfc/libfc.ko 2020-11-20T12:05:47.986 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/libiscsi.ko 2020-11-20T12:05:47.986 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/libiscsi_tcp.ko 2020-11-20T12:05:47.987 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/libsas 2020-11-20T12:05:47.987 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/libsas/libsas.ko 2020-11-20T12:05:47.987 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/lpfc 2020-11-20T12:05:47.988 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/lpfc/lpfc.ko 2020-11-20T12:05:47.988 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/megaraid 2020-11-20T12:05:47.989 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/megaraid.ko 2020-11-20T12:05:47.990 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2020-11-20T12:05:47.990 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2020-11-20T12:05:47.990 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2020-11-20T12:05:47.990 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/mpt3sas 2020-11-20T12:05:47.991 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2020-11-20T12:05:47.991 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/mvsas 2020-11-20T12:05:47.991 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/mvsas/mvsas.ko 2020-11-20T12:05:47.991 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/mvumi.ko 2020-11-20T12:05:47.991 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/pm8001 2020-11-20T12:05:47.992 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/pm8001/pm80xx.ko 2020-11-20T12:05:47.992 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/pmcraid.ko 2020-11-20T12:05:47.992 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/qla1280.ko 2020-11-20T12:05:47.992 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/qla2xxx 2020-11-20T12:05:47.993 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2020-11-20T12:05:47.993 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2020-11-20T12:05:47.993 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/qla4xxx 2020-11-20T12:05:47.994 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2020-11-20T12:05:47.994 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/raid_class.ko 2020-11-20T12:05:47.994 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/scsi_debug.ko 2020-11-20T12:05:47.994 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/scsi_transport_fc.ko 2020-11-20T12:05:47.995 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/scsi_transport_iscsi.ko 2020-11-20T12:05:47.995 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/scsi_transport_sas.ko 2020-11-20T12:05:47.995 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/scsi_transport_spi.ko 2020-11-20T12:05:47.995 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/scsi_transport_srp.ko 2020-11-20T12:05:47.995 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/ses.ko 2020-11-20T12:05:47.996 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/st.ko 2020-11-20T12:05:47.996 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/stex.ko 2020-11-20T12:05:47.996 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/sym53c8xx_2 2020-11-20T12:05:47.996 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2020-11-20T12:05:47.996 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/ufs 2020-11-20T12:05:47.997 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/ufs/ufshcd-core.ko 2020-11-20T12:05:47.997 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2020-11-20T12:05:47.997 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/virtio_scsi.ko 2020-11-20T12:05:47.997 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/vmw_pvscsi.ko 2020-11-20T12:05:47.998 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/scsi/wd719x.ko 2020-11-20T12:05:47.998 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ssb 2020-11-20T12:05:47.998 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/ssb/ssb.ko 2020-11-20T12:05:47.998 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target 2020-11-20T12:05:47.998 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/iscsi 2020-11-20T12:05:47.999 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2020-11-20T12:05:47.999 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/loopback 2020-11-20T12:05:47.999 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/loopback/tcm_loop.ko 2020-11-20T12:05:47.999 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/target_core_file.ko 2020-11-20T12:05:48.000 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/target_core_iblock.ko 2020-11-20T12:05:48.001 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/target_core_mod.ko 2020-11-20T12:05:48.001 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/target_core_pscsi.ko 2020-11-20T12:05:48.001 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/target_core_user.ko 2020-11-20T12:05:48.002 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/tcm_fc 2020-11-20T12:05:48.002 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/target/tcm_fc/tcm_fc.ko 2020-11-20T12:05:48.003 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal 2020-11-20T12:05:48.003 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel 2020-11-20T12:05:48.003 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/int340x_thermal 2020-11-20T12:05:48.004 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2020-11-20T12:05:48.004 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2020-11-20T12:05:48.005 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2020-11-20T12:05:48.005 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2020-11-20T12:05:48.005 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2020-11-20T12:05:48.006 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2020-11-20T12:05:48.006 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2020-11-20T12:05:48.006 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2020-11-20T12:05:48.007 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2020-11-20T12:05:48.007 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty 2020-11-20T12:05:48.008 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/cyclades.ko 2020-11-20T12:05:48.008 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/ipwireless 2020-11-20T12:05:48.008 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/ipwireless/ipwireless.ko 2020-11-20T12:05:48.009 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/n_gsm.ko 2020-11-20T12:05:48.009 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/n_hdlc.ko 2020-11-20T12:05:48.010 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/nozomi.ko 2020-11-20T12:05:48.010 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/rocket.ko 2020-11-20T12:05:48.010 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/serial 2020-11-20T12:05:48.011 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/serial/8250 2020-11-20T12:05:48.011 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/serial/8250/serial_cs.ko 2020-11-20T12:05:48.012 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/serial/arc_uart.ko 2020-11-20T12:05:48.012 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/serial/jsm 2020-11-20T12:05:48.012 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/serial/jsm/jsm.ko 2020-11-20T12:05:48.013 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/synclink.ko 2020-11-20T12:05:48.013 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/synclink_gt.ko 2020-11-20T12:05:48.013 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/tty/synclinkmp.ko 2020-11-20T12:05:48.014 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/uio 2020-11-20T12:05:48.014 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/uio/uio.ko 2020-11-20T12:05:48.014 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/uio/uio_aec.ko 2020-11-20T12:05:48.015 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/uio/uio_cif.ko 2020-11-20T12:05:48.015 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/uio/uio_pci_generic.ko 2020-11-20T12:05:48.015 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/uio/uio_sercos3.ko 2020-11-20T12:05:48.015 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb 2020-11-20T12:05:48.015 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/class 2020-11-20T12:05:48.016 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/class/cdc-acm.ko 2020-11-20T12:05:48.016 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/class/cdc-wdm.ko 2020-11-20T12:05:48.016 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/class/usblp.ko 2020-11-20T12:05:48.016 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/class/usbtmc.ko 2020-11-20T12:05:48.016 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/host 2020-11-20T12:05:48.017 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/host/sl811-hcd.ko 2020-11-20T12:05:48.017 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/host/u132-hcd.ko 2020-11-20T12:05:48.017 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/image 2020-11-20T12:05:48.017 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/image/mdc800.ko 2020-11-20T12:05:48.018 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/image/microtek.ko 2020-11-20T12:05:48.018 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc 2020-11-20T12:05:48.018 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/adutux.ko 2020-11-20T12:05:48.018 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/appledisplay.ko 2020-11-20T12:05:48.018 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/emi26.ko 2020-11-20T12:05:48.019 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/emi62.ko 2020-11-20T12:05:48.019 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/ezusb.ko 2020-11-20T12:05:48.019 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/ftdi-elan.ko 2020-11-20T12:05:48.019 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/idmouse.ko 2020-11-20T12:05:48.019 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/iowarrior.ko 2020-11-20T12:05:48.020 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/isight_firmware.ko 2020-11-20T12:05:48.020 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/ldusb.ko 2020-11-20T12:05:48.020 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/legousbtower.ko 2020-11-20T12:05:48.020 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/sisusbvga 2020-11-20T12:05:48.020 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2020-11-20T12:05:48.021 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/trancevibrator.ko 2020-11-20T12:05:48.021 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/usb3503.ko 2020-11-20T12:05:48.021 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/usblcd.ko 2020-11-20T12:05:48.021 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/usbsevseg.ko 2020-11-20T12:05:48.022 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/uss720.ko 2020-11-20T12:05:48.022 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/misc/yurex.ko 2020-11-20T12:05:48.022 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/phy 2020-11-20T12:05:48.022 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/phy/phy-generic.ko 2020-11-20T12:05:48.022 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial 2020-11-20T12:05:48.023 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/aircable.ko 2020-11-20T12:05:48.023 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ark3116.ko 2020-11-20T12:05:48.023 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/belkin_sa.ko 2020-11-20T12:05:48.023 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ch341.ko 2020-11-20T12:05:48.023 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/cp210x.ko 2020-11-20T12:05:48.024 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/cyberjack.ko 2020-11-20T12:05:48.024 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/cypress_m8.ko 2020-11-20T12:05:48.025 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/digi_acceleport.ko 2020-11-20T12:05:48.025 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/empeg.ko 2020-11-20T12:05:48.025 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ftdi_sio.ko 2020-11-20T12:05:48.026 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/garmin_gps.ko 2020-11-20T12:05:48.026 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/io_edgeport.ko 2020-11-20T12:05:48.026 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/io_ti.ko 2020-11-20T12:05:48.027 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ipaq.ko 2020-11-20T12:05:48.027 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ipw.ko 2020-11-20T12:05:48.028 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ir-usb.ko 2020-11-20T12:05:48.028 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/iuu_phoenix.ko 2020-11-20T12:05:48.028 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/keyspan.ko 2020-11-20T12:05:48.029 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/keyspan_pda.ko 2020-11-20T12:05:48.029 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/kl5kusb105.ko 2020-11-20T12:05:48.030 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/kobil_sct.ko 2020-11-20T12:05:48.030 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/mct_u232.ko 2020-11-20T12:05:48.030 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/mos7720.ko 2020-11-20T12:05:48.031 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/mos7840.ko 2020-11-20T12:05:48.031 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/navman.ko 2020-11-20T12:05:48.032 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/omninet.ko 2020-11-20T12:05:48.032 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/opticon.ko 2020-11-20T12:05:48.032 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/option.ko 2020-11-20T12:05:48.033 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/oti6858.ko 2020-11-20T12:05:48.033 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/pl2303.ko 2020-11-20T12:05:48.034 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/qcaux.ko 2020-11-20T12:05:48.034 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/qcserial.ko 2020-11-20T12:05:48.034 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/quatech2.ko 2020-11-20T12:05:48.034 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/safe_serial.ko 2020-11-20T12:05:48.035 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/sierra.ko 2020-11-20T12:05:48.035 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/spcp8x5.ko 2020-11-20T12:05:48.035 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ssu100.ko 2020-11-20T12:05:48.035 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/symbolserial.ko 2020-11-20T12:05:48.036 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2020-11-20T12:05:48.036 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/usb-serial-simple.ko 2020-11-20T12:05:48.036 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/usb_debug.ko 2020-11-20T12:05:48.037 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/usb_wwan.ko 2020-11-20T12:05:48.037 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/visor.ko 2020-11-20T12:05:48.037 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/whiteheat.ko 2020-11-20T12:05:48.038 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/serial/xsens_mt.ko 2020-11-20T12:05:48.038 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage 2020-11-20T12:05:48.038 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/uas.ko 2020-11-20T12:05:48.039 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-alauda.ko 2020-11-20T12:05:48.039 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-cypress.ko 2020-11-20T12:05:48.040 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-datafab.ko 2020-11-20T12:05:48.040 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-eneub6250.ko 2020-11-20T12:05:48.040 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-freecom.ko 2020-11-20T12:05:48.041 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-isd200.ko 2020-11-20T12:05:48.041 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-jumpshot.ko 2020-11-20T12:05:48.041 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-karma.ko 2020-11-20T12:05:48.042 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-onetouch.ko 2020-11-20T12:05:48.042 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-realtek.ko 2020-11-20T12:05:48.042 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-sddr09.ko 2020-11-20T12:05:48.043 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-sddr55.ko 2020-11-20T12:05:48.043 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/ums-usbat.ko 2020-11-20T12:05:48.043 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/storage/usb-storage.ko 2020-11-20T12:05:48.044 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/usbip 2020-11-20T12:05:48.044 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/usbip/usbip-core.ko 2020-11-20T12:05:48.044 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/usbip/usbip-host.ko 2020-11-20T12:05:48.045 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/usb/usbip/vhci-hcd.ko 2020-11-20T12:05:48.045 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vfio 2020-11-20T12:05:48.046 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vfio/pci 2020-11-20T12:05:48.046 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vfio/pci/vfio-pci.ko 2020-11-20T12:05:48.046 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vfio/vfio.ko 2020-11-20T12:05:48.047 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vfio/vfio_iommu_type1.ko 2020-11-20T12:05:48.047 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vfio/vfio_virqfd.ko 2020-11-20T12:05:48.047 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vhost 2020-11-20T12:05:48.048 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vhost/vhost.ko 2020-11-20T12:05:48.048 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vhost/vhost_iotlb.ko 2020-11-20T12:05:48.049 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vhost/vhost_net.ko 2020-11-20T12:05:48.049 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/vhost/vhost_scsi.ko 2020-11-20T12:05:48.049 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/video 2020-11-20T12:05:48.050 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/video/backlight 2020-11-20T12:05:48.050 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/video/backlight/apple_bl.ko 2020-11-20T12:05:48.051 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/video/backlight/lcd.ko 2020-11-20T12:05:48.051 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/video/backlight/platform_lcd.ko 2020-11-20T12:05:48.051 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/virtio 2020-11-20T12:05:48.052 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/virtio/virtio.ko 2020-11-20T12:05:48.052 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/virtio/virtio_balloon.ko 2020-11-20T12:05:48.053 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/virtio/virtio_mmio.ko 2020-11-20T12:05:48.053 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/virtio/virtio_pci.ko 2020-11-20T12:05:48.053 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/virtio/virtio_ring.ko 2020-11-20T12:05:48.054 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1 2020-11-20T12:05:48.054 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/masters 2020-11-20T12:05:48.055 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/masters/ds1wm.ko 2020-11-20T12:05:48.055 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/masters/ds2482.ko 2020-11-20T12:05:48.055 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/masters/ds2490.ko 2020-11-20T12:05:48.056 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves 2020-11-20T12:05:48.056 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2406.ko 2020-11-20T12:05:48.056 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2408.ko 2020-11-20T12:05:48.057 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2413.ko 2020-11-20T12:05:48.057 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2423.ko 2020-11-20T12:05:48.058 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2431.ko 2020-11-20T12:05:48.058 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2433.ko 2020-11-20T12:05:48.058 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2780.ko 2020-11-20T12:05:48.059 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds2781.ko 2020-11-20T12:05:48.059 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_ds28e04.ko 2020-11-20T12:05:48.060 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_smem.ko 2020-11-20T12:05:48.060 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/slaves/w1_therm.ko 2020-11-20T12:05:48.060 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/w1/wire.ko 2020-11-20T12:05:48.061 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog 2020-11-20T12:05:48.061 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/alim1535_wdt.ko 2020-11-20T12:05:48.062 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/alim7101_wdt.ko 2020-11-20T12:05:48.062 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/f71808e_wdt.ko 2020-11-20T12:05:48.062 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/hpwdt.ko 2020-11-20T12:05:48.063 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/i6300esb.ko 2020-11-20T12:05:48.063 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/iTCO_vendor_support.ko 2020-11-20T12:05:48.063 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/iTCO_wdt.ko 2020-11-20T12:05:48.064 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/ib700wdt.ko 2020-11-20T12:05:48.064 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/ibmasr.ko 2020-11-20T12:05:48.065 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/ie6xx_wdt.ko 2020-11-20T12:05:48.065 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/it8712f_wdt.ko 2020-11-20T12:05:48.065 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/it87_wdt.ko 2020-11-20T12:05:48.066 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/machzwd.ko 2020-11-20T12:05:48.066 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/nv_tco.ko 2020-11-20T12:05:48.067 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/pcwd_pci.ko 2020-11-20T12:05:48.067 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/pcwd_usb.ko 2020-11-20T12:05:48.067 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2020-11-20T12:05:48.068 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/sch311x_wdt.ko 2020-11-20T12:05:48.068 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/softdog.ko 2020-11-20T12:05:48.068 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/sp5100_tco.ko 2020-11-20T12:05:48.069 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/via_wdt.ko 2020-11-20T12:05:48.069 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/w83627hf_wdt.ko 2020-11-20T12:05:48.070 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/w83877f_wdt.ko 2020-11-20T12:05:48.070 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/w83977f_wdt.ko 2020-11-20T12:05:48.070 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/wdt_pci.ko 2020-11-20T12:05:48.071 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/watchdog/xen_wdt.ko 2020-11-20T12:05:48.071 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen 2020-11-20T12:05:48.071 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xen-acpi-processor.ko 2020-11-20T12:05:48.071 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xen-evtchn.ko 2020-11-20T12:05:48.072 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xen-gntalloc.ko 2020-11-20T12:05:48.072 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xen-gntdev.ko 2020-11-20T12:05:48.072 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xen-pciback 2020-11-20T12:05:48.073 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2020-11-20T12:05:48.073 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xen-privcmd.ko 2020-11-20T12:05:48.073 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xenfs 2020-11-20T12:05:48.073 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/drivers/xen/xenfs/xenfs.ko 2020-11-20T12:05:48.073 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs 2020-11-20T12:05:48.074 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/9p 2020-11-20T12:05:48.074 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/9p/9p.ko 2020-11-20T12:05:48.074 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/affs 2020-11-20T12:05:48.074 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/affs/affs.ko 2020-11-20T12:05:48.074 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/befs 2020-11-20T12:05:48.075 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/befs/befs.ko 2020-11-20T12:05:48.075 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/binfmt_misc.ko 2020-11-20T12:05:48.075 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/btrfs 2020-11-20T12:05:48.075 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/btrfs/btrfs.ko 2020-11-20T12:05:48.076 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/cachefiles 2020-11-20T12:05:48.076 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/cachefiles/cachefiles.ko 2020-11-20T12:05:48.076 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ceph 2020-11-20T12:05:48.076 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ceph/ceph.ko 2020-11-20T12:05:48.077 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/cifs 2020-11-20T12:05:48.077 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/cifs/cifs.ko 2020-11-20T12:05:48.077 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/coda 2020-11-20T12:05:48.077 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/coda/coda.ko 2020-11-20T12:05:48.078 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/cramfs 2020-11-20T12:05:48.078 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/cramfs/cramfs.ko 2020-11-20T12:05:48.079 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/dlm 2020-11-20T12:05:48.079 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/dlm/dlm.ko 2020-11-20T12:05:48.079 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ecryptfs 2020-11-20T12:05:48.080 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ecryptfs/ecryptfs.ko 2020-11-20T12:05:48.080 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/f2fs 2020-11-20T12:05:48.080 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/f2fs/f2fs.ko 2020-11-20T12:05:48.081 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fat 2020-11-20T12:05:48.081 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fat/fat.ko 2020-11-20T12:05:48.082 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fat/msdos.ko 2020-11-20T12:05:48.082 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fat/vfat.ko 2020-11-20T12:05:48.082 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fscache 2020-11-20T12:05:48.083 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fscache/fscache.ko 2020-11-20T12:05:48.083 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fuse 2020-11-20T12:05:48.083 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fuse/cuse.ko 2020-11-20T12:05:48.084 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/fuse/fuse.ko 2020-11-20T12:05:48.084 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/gfs2 2020-11-20T12:05:48.085 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/gfs2/gfs2.ko 2020-11-20T12:05:48.085 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/hfs 2020-11-20T12:05:48.085 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/hfs/hfs.ko 2020-11-20T12:05:48.086 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/hfsplus 2020-11-20T12:05:48.086 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/hfsplus/hfsplus.ko 2020-11-20T12:05:48.086 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/isofs 2020-11-20T12:05:48.086 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/isofs/isofs.ko 2020-11-20T12:05:48.087 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/jfs 2020-11-20T12:05:48.087 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/jfs/jfs.ko 2020-11-20T12:05:48.088 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/lockd 2020-11-20T12:05:48.088 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/lockd/lockd.ko 2020-11-20T12:05:48.088 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/minix 2020-11-20T12:05:48.089 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/minix/minix.ko 2020-11-20T12:05:48.089 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs 2020-11-20T12:05:48.090 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/blocklayout 2020-11-20T12:05:48.090 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2020-11-20T12:05:48.090 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/filelayout 2020-11-20T12:05:48.091 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2020-11-20T12:05:48.091 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/flexfilelayout 2020-11-20T12:05:48.091 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2020-11-20T12:05:48.092 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/nfs.ko 2020-11-20T12:05:48.092 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/nfsv3.ko 2020-11-20T12:05:48.093 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs/nfsv4.ko 2020-11-20T12:05:48.093 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs_common 2020-11-20T12:05:48.093 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs_common/grace.ko 2020-11-20T12:05:48.094 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs_common/nfs_acl.ko 2020-11-20T12:05:48.094 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfs_common/nfs_ssc.ko 2020-11-20T12:05:48.095 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfsd 2020-11-20T12:05:48.095 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nfsd/nfsd.ko 2020-11-20T12:05:48.095 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nilfs2 2020-11-20T12:05:48.096 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nilfs2/nilfs2.ko 2020-11-20T12:05:48.096 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls 2020-11-20T12:05:48.097 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-celtic.ko 2020-11-20T12:05:48.097 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-centeuro.ko 2020-11-20T12:05:48.097 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-croatian.ko 2020-11-20T12:05:48.098 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-cyrillic.ko 2020-11-20T12:05:48.098 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-gaelic.ko 2020-11-20T12:05:48.098 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-greek.ko 2020-11-20T12:05:48.099 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-iceland.ko 2020-11-20T12:05:48.099 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-inuit.ko 2020-11-20T12:05:48.100 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-roman.ko 2020-11-20T12:05:48.100 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-romanian.ko 2020-11-20T12:05:48.100 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/mac-turkish.ko 2020-11-20T12:05:48.101 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp1250.ko 2020-11-20T12:05:48.101 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp1251.ko 2020-11-20T12:05:48.102 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp1255.ko 2020-11-20T12:05:48.102 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp737.ko 2020-11-20T12:05:48.102 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp775.ko 2020-11-20T12:05:48.103 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp850.ko 2020-11-20T12:05:48.103 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp852.ko 2020-11-20T12:05:48.103 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp855.ko 2020-11-20T12:05:48.103 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp857.ko 2020-11-20T12:05:48.104 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp860.ko 2020-11-20T12:05:48.104 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp861.ko 2020-11-20T12:05:48.105 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp862.ko 2020-11-20T12:05:48.105 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp863.ko 2020-11-20T12:05:48.105 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp864.ko 2020-11-20T12:05:48.106 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp865.ko 2020-11-20T12:05:48.106 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp866.ko 2020-11-20T12:05:48.107 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp869.ko 2020-11-20T12:05:48.107 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp874.ko 2020-11-20T12:05:48.107 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp932.ko 2020-11-20T12:05:48.108 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp936.ko 2020-11-20T12:05:48.108 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp949.ko 2020-11-20T12:05:48.109 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_cp950.ko 2020-11-20T12:05:48.109 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_euc-jp.ko 2020-11-20T12:05:48.109 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-1.ko 2020-11-20T12:05:48.110 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-13.ko 2020-11-20T12:05:48.110 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-14.ko 2020-11-20T12:05:48.110 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-15.ko 2020-11-20T12:05:48.111 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-2.ko 2020-11-20T12:05:48.111 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-3.ko 2020-11-20T12:05:48.112 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-4.ko 2020-11-20T12:05:48.112 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-5.ko 2020-11-20T12:05:48.112 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-6.ko 2020-11-20T12:05:48.113 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-7.ko 2020-11-20T12:05:48.113 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_iso8859-9.ko 2020-11-20T12:05:48.113 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_koi8-r.ko 2020-11-20T12:05:48.114 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_koi8-ru.ko 2020-11-20T12:05:48.114 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_koi8-u.ko 2020-11-20T12:05:48.115 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/nls/nls_utf8.ko 2020-11-20T12:05:48.115 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2 2020-11-20T12:05:48.115 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/cluster 2020-11-20T12:05:48.116 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2020-11-20T12:05:48.116 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/dlm 2020-11-20T12:05:48.117 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2020-11-20T12:05:48.117 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/dlmfs 2020-11-20T12:05:48.117 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2020-11-20T12:05:48.118 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/ocfs2.ko 2020-11-20T12:05:48.118 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2020-11-20T12:05:48.119 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/ocfs2_stack_user.ko 2020-11-20T12:05:48.119 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ocfs2/ocfs2_stackglue.ko 2020-11-20T12:05:48.119 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/overlayfs 2020-11-20T12:05:48.120 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/overlayfs/overlay.ko 2020-11-20T12:05:48.120 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/pstore 2020-11-20T12:05:48.120 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/pstore/ramoops.ko 2020-11-20T12:05:48.121 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/reiserfs 2020-11-20T12:05:48.121 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/reiserfs/reiserfs.ko 2020-11-20T12:05:48.122 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/romfs 2020-11-20T12:05:48.122 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/romfs/romfs.ko 2020-11-20T12:05:48.122 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/squashfs 2020-11-20T12:05:48.122 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/squashfs/squashfs.ko 2020-11-20T12:05:48.122 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/sysv 2020-11-20T12:05:48.123 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/sysv/sysv.ko 2020-11-20T12:05:48.123 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/udf 2020-11-20T12:05:48.123 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/udf/udf.ko 2020-11-20T12:05:48.124 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ufs 2020-11-20T12:05:48.124 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/ufs/ufs.ko 2020-11-20T12:05:48.125 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/xfs 2020-11-20T12:05:48.125 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/fs/xfs/xfs.ko 2020-11-20T12:05:48.125 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/kernel 2020-11-20T12:05:48.126 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/kernel/rcu 2020-11-20T12:05:48.126 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/kernel/rcu/rcutorture.ko 2020-11-20T12:05:48.126 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/kernel/torture.ko 2020-11-20T12:05:48.127 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/kernel/trace 2020-11-20T12:05:48.127 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/kernel/trace/ring_buffer_benchmark.ko 2020-11-20T12:05:48.128 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib 2020-11-20T12:05:48.128 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/crc-itu-t.ko 2020-11-20T12:05:48.128 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/crc64.ko 2020-11-20T12:05:48.129 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/crc8.ko 2020-11-20T12:05:48.129 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/crypto 2020-11-20T12:05:48.130 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/crypto/libarc4.ko 2020-11-20T12:05:48.130 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/crypto/libdes.ko 2020-11-20T12:05:48.130 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/libcrc32c.ko 2020-11-20T12:05:48.131 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/lru_cache.ko 2020-11-20T12:05:48.131 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/lz4 2020-11-20T12:05:48.131 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/lz4/lz4_compress.ko 2020-11-20T12:05:48.132 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/lz4/lz4hc_compress.ko 2020-11-20T12:05:48.132 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/math 2020-11-20T12:05:48.133 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/math/cordic.ko 2020-11-20T12:05:48.133 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/raid6 2020-11-20T12:05:48.133 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/raid6/raid6_pq.ko 2020-11-20T12:05:48.134 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/reed_solomon 2020-11-20T12:05:48.134 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/reed_solomon/reed_solomon.ko 2020-11-20T12:05:48.134 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/ts_bm.ko 2020-11-20T12:05:48.135 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/ts_fsm.ko 2020-11-20T12:05:48.135 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/ts_kmp.ko 2020-11-20T12:05:48.135 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/zstd 2020-11-20T12:05:48.136 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/lib/zstd/zstd_compress.ko 2020-11-20T12:05:48.136 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/mm 2020-11-20T12:05:48.137 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/mm/hwpoison-inject.ko 2020-11-20T12:05:48.137 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net 2020-11-20T12:05:48.137 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan 2020-11-20T12:05:48.138 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/6lowpan.ko 2020-11-20T12:05:48.138 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/nhc_dest.ko 2020-11-20T12:05:48.138 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/nhc_fragment.ko 2020-11-20T12:05:48.139 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/nhc_hop.ko 2020-11-20T12:05:48.139 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/nhc_ipv6.ko 2020-11-20T12:05:48.140 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/nhc_mobility.ko 2020-11-20T12:05:48.141 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/nhc_routing.ko 2020-11-20T12:05:48.141 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/6lowpan/nhc_udp.ko 2020-11-20T12:05:48.142 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/802 2020-11-20T12:05:48.142 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/802/garp.ko 2020-11-20T12:05:48.142 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/802/mrp.ko 2020-11-20T12:05:48.143 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/802/p8022.ko 2020-11-20T12:05:48.143 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/802/psnap.ko 2020-11-20T12:05:48.143 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/802/stp.ko 2020-11-20T12:05:48.144 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/8021q 2020-11-20T12:05:48.144 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/8021q/8021q.ko 2020-11-20T12:05:48.144 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/9p 2020-11-20T12:05:48.145 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/9p/9pnet.ko 2020-11-20T12:05:48.145 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/9p/9pnet_rdma.ko 2020-11-20T12:05:48.145 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/9p/9pnet_virtio.ko 2020-11-20T12:05:48.146 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/batman-adv 2020-11-20T12:05:48.146 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/batman-adv/batman-adv.ko 2020-11-20T12:05:48.146 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge 2020-11-20T12:05:48.146 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/br_netfilter.ko 2020-11-20T12:05:48.147 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/bridge.ko 2020-11-20T12:05:48.147 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter 2020-11-20T12:05:48.148 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_802_3.ko 2020-11-20T12:05:48.148 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_among.ko 2020-11-20T12:05:48.148 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_arp.ko 2020-11-20T12:05:48.149 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_arpreply.ko 2020-11-20T12:05:48.149 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_dnat.ko 2020-11-20T12:05:48.150 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_ip.ko 2020-11-20T12:05:48.150 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_ip6.ko 2020-11-20T12:05:48.150 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_limit.ko 2020-11-20T12:05:48.151 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_log.ko 2020-11-20T12:05:48.151 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_mark.ko 2020-11-20T12:05:48.151 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_mark_m.ko 2020-11-20T12:05:48.152 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_nflog.ko 2020-11-20T12:05:48.152 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_pkttype.ko 2020-11-20T12:05:48.153 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_redirect.ko 2020-11-20T12:05:48.153 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_snat.ko 2020-11-20T12:05:48.153 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_stp.ko 2020-11-20T12:05:48.154 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebt_vlan.ko 2020-11-20T12:05:48.154 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebtable_broute.ko 2020-11-20T12:05:48.155 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebtable_filter.ko 2020-11-20T12:05:48.155 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebtable_nat.ko 2020-11-20T12:05:48.155 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/ebtables.ko 2020-11-20T12:05:48.156 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2020-11-20T12:05:48.156 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/nf_log_bridge.ko 2020-11-20T12:05:48.157 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2020-11-20T12:05:48.157 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2020-11-20T12:05:48.157 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ceph 2020-11-20T12:05:48.158 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ceph/libceph.ko 2020-11-20T12:05:48.158 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/core 2020-11-20T12:05:48.158 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/core/failover.ko 2020-11-20T12:05:48.159 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/core/pktgen.ko 2020-11-20T12:05:48.159 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dccp 2020-11-20T12:05:48.160 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dccp/dccp.ko 2020-11-20T12:05:48.160 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dccp/dccp_diag.ko 2020-11-20T12:05:48.160 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dccp/dccp_ipv4.ko 2020-11-20T12:05:48.161 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dccp/dccp_ipv6.ko 2020-11-20T12:05:48.161 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dns_resolver 2020-11-20T12:05:48.162 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dns_resolver/dns_resolver.ko 2020-11-20T12:05:48.162 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dsa 2020-11-20T12:05:48.162 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dsa/dsa_core.ko 2020-11-20T12:05:48.163 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dsa/tag_brcm.ko 2020-11-20T12:05:48.163 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dsa/tag_dsa.ko 2020-11-20T12:05:48.163 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dsa/tag_edsa.ko 2020-11-20T12:05:48.163 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/dsa/tag_trailer.ko 2020-11-20T12:05:48.164 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ieee802154 2020-11-20T12:05:48.164 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ieee802154/6lowpan 2020-11-20T12:05:48.164 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2020-11-20T12:05:48.164 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ieee802154/ieee802154.ko 2020-11-20T12:05:48.165 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ieee802154/ieee802154_socket.ko 2020-11-20T12:05:48.165 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4 2020-11-20T12:05:48.165 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/ah4.ko 2020-11-20T12:05:48.165 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/esp4.ko 2020-11-20T12:05:48.166 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/fou.ko 2020-11-20T12:05:48.166 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/gre.ko 2020-11-20T12:05:48.166 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/inet_diag.ko 2020-11-20T12:05:48.167 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/ip_gre.ko 2020-11-20T12:05:48.167 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/ip_tunnel.ko 2020-11-20T12:05:48.168 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/ip_vti.ko 2020-11-20T12:05:48.168 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/ipcomp.ko 2020-11-20T12:05:48.168 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/ipip.ko 2020-11-20T12:05:48.168 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter 2020-11-20T12:05:48.169 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/arp_tables.ko 2020-11-20T12:05:48.169 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/arpt_mangle.ko 2020-11-20T12:05:48.169 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/arptable_filter.ko 2020-11-20T12:05:48.170 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2020-11-20T12:05:48.170 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/ipt_ECN.ko 2020-11-20T12:05:48.170 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2020-11-20T12:05:48.170 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/ipt_ah.ko 2020-11-20T12:05:48.171 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2020-11-20T12:05:48.171 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/iptable_mangle.ko 2020-11-20T12:05:48.171 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/iptable_nat.ko 2020-11-20T12:05:48.172 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/iptable_raw.ko 2020-11-20T12:05:48.172 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/iptable_security.ko 2020-11-20T12:05:48.172 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2020-11-20T12:05:48.172 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2020-11-20T12:05:48.173 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_log_arp.ko 2020-11-20T12:05:48.173 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_log_ipv4.ko 2020-11-20T12:05:48.173 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2020-11-20T12:05:48.173 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2020-11-20T12:05:48.174 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2020-11-20T12:05:48.174 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2020-11-20T12:05:48.174 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2020-11-20T12:05:48.174 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2020-11-20T12:05:48.174 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2020-11-20T12:05:48.175 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2020-11-20T12:05:48.175 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_bic.ko 2020-11-20T12:05:48.175 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_dctcp.ko 2020-11-20T12:05:48.175 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_diag.ko 2020-11-20T12:05:48.175 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_highspeed.ko 2020-11-20T12:05:48.176 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_htcp.ko 2020-11-20T12:05:48.176 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_hybla.ko 2020-11-20T12:05:48.176 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_illinois.ko 2020-11-20T12:05:48.176 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_lp.ko 2020-11-20T12:05:48.176 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_scalable.ko 2020-11-20T12:05:48.177 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_vegas.ko 2020-11-20T12:05:48.177 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_veno.ko 2020-11-20T12:05:48.177 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_westwood.ko 2020-11-20T12:05:48.177 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tcp_yeah.ko 2020-11-20T12:05:48.178 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/tunnel4.ko 2020-11-20T12:05:48.178 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/udp_diag.ko 2020-11-20T12:05:48.178 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/udp_tunnel.ko 2020-11-20T12:05:48.178 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv4/xfrm4_tunnel.ko 2020-11-20T12:05:48.179 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6 2020-11-20T12:05:48.179 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/ah6.ko 2020-11-20T12:05:48.179 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/esp6.ko 2020-11-20T12:05:48.179 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/fou6.ko 2020-11-20T12:05:48.179 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/ip6_tunnel.ko 2020-11-20T12:05:48.180 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/ip6_udp_tunnel.ko 2020-11-20T12:05:48.180 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/ip6_vti.ko 2020-11-20T12:05:48.180 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/ipcomp6.ko 2020-11-20T12:05:48.180 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter 2020-11-20T12:05:48.181 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6_tables.ko 2020-11-20T12:05:48.181 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2020-11-20T12:05:48.181 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2020-11-20T12:05:48.181 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_ah.ko 2020-11-20T12:05:48.182 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2020-11-20T12:05:48.182 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_frag.ko 2020-11-20T12:05:48.182 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2020-11-20T12:05:48.182 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2020-11-20T12:05:48.182 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_mh.ko 2020-11-20T12:05:48.183 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2020-11-20T12:05:48.183 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6t_rt.ko 2020-11-20T12:05:48.183 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6table_filter.ko 2020-11-20T12:05:48.183 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2020-11-20T12:05:48.183 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6table_nat.ko 2020-11-20T12:05:48.184 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6table_raw.ko 2020-11-20T12:05:48.184 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/ip6table_security.ko 2020-11-20T12:05:48.184 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2020-11-20T12:05:48.184 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2020-11-20T12:05:48.185 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nf_flow_table_ipv6.ko 2020-11-20T12:05:48.185 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nf_log_ipv6.ko 2020-11-20T12:05:48.185 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2020-11-20T12:05:48.185 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2020-11-20T12:05:48.185 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2020-11-20T12:05:48.186 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2020-11-20T12:05:48.186 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2020-11-20T12:05:48.186 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2020-11-20T12:05:48.186 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/sit.ko 2020-11-20T12:05:48.186 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/tunnel6.ko 2020-11-20T12:05:48.187 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/ipv6/xfrm6_tunnel.ko 2020-11-20T12:05:48.187 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/key 2020-11-20T12:05:48.187 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/key/af_key.ko 2020-11-20T12:05:48.187 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp 2020-11-20T12:05:48.188 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp/l2tp_core.ko 2020-11-20T12:05:48.188 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp/l2tp_debugfs.ko 2020-11-20T12:05:48.188 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp/l2tp_eth.ko 2020-11-20T12:05:48.188 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp/l2tp_ip.ko 2020-11-20T12:05:48.189 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp/l2tp_ip6.ko 2020-11-20T12:05:48.189 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp/l2tp_netlink.ko 2020-11-20T12:05:48.189 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/l2tp/l2tp_ppp.ko 2020-11-20T12:05:48.189 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/llc 2020-11-20T12:05:48.190 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/llc/llc.ko 2020-11-20T12:05:48.190 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/mac802154 2020-11-20T12:05:48.190 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/mac802154/mac802154.ko 2020-11-20T12:05:48.190 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/mpls 2020-11-20T12:05:48.191 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/mpls/mpls_gso.ko 2020-11-20T12:05:48.191 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter 2020-11-20T12:05:48.191 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset 2020-11-20T12:05:48.191 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set.ko 2020-11-20T12:05:48.192 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2020-11-20T12:05:48.192 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2020-11-20T12:05:48.192 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2020-11-20T12:05:48.192 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2020-11-20T12:05:48.192 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2020-11-20T12:05:48.193 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2020-11-20T12:05:48.193 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2020-11-20T12:05:48.193 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2020-11-20T12:05:48.193 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2020-11-20T12:05:48.194 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2020-11-20T12:05:48.194 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2020-11-20T12:05:48.194 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2020-11-20T12:05:48.194 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2020-11-20T12:05:48.194 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2020-11-20T12:05:48.195 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipset/ip_set_list_set.ko 2020-11-20T12:05:48.195 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs 2020-11-20T12:05:48.195 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs.ko 2020-11-20T12:05:48.195 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2020-11-20T12:05:48.195 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2020-11-20T12:05:48.196 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2020-11-20T12:05:48.196 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2020-11-20T12:05:48.196 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2020-11-20T12:05:48.196 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2020-11-20T12:05:48.196 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2020-11-20T12:05:48.197 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2020-11-20T12:05:48.197 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2020-11-20T12:05:48.197 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2020-11-20T12:05:48.197 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2020-11-20T12:05:48.198 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2020-11-20T12:05:48.198 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2020-11-20T12:05:48.198 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conncount.ko 2020-11-20T12:05:48.198 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack.ko 2020-11-20T12:05:48.198 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_amanda.ko 2020-11-20T12:05:48.199 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_broadcast.ko 2020-11-20T12:05:48.199 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_ftp.ko 2020-11-20T12:05:48.199 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_h323.ko 2020-11-20T12:05:48.199 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_irc.ko 2020-11-20T12:05:48.200 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2020-11-20T12:05:48.200 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_netlink.ko 2020-11-20T12:05:48.200 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_pptp.ko 2020-11-20T12:05:48.200 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_sane.ko 2020-11-20T12:05:48.200 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_sip.ko 2020-11-20T12:05:48.201 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_snmp.ko 2020-11-20T12:05:48.201 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_conntrack_tftp.ko 2020-11-20T12:05:48.201 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_dup_netdev.ko 2020-11-20T12:05:48.201 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_flow_table.ko 2020-11-20T12:05:48.201 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_flow_table_inet.ko 2020-11-20T12:05:48.202 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_log_common.ko 2020-11-20T12:05:48.202 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_nat.ko 2020-11-20T12:05:48.202 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_nat_amanda.ko 2020-11-20T12:05:48.202 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_nat_ftp.ko 2020-11-20T12:05:48.202 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_nat_irc.ko 2020-11-20T12:05:48.203 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_nat_sip.ko 2020-11-20T12:05:48.203 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_nat_tftp.ko 2020-11-20T12:05:48.203 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_synproxy_core.ko 2020-11-20T12:05:48.203 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nf_tables.ko 2020-11-20T12:05:48.203 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nfnetlink.ko 2020-11-20T12:05:48.204 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nfnetlink_acct.ko 2020-11-20T12:05:48.204 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nfnetlink_log.ko 2020-11-20T12:05:48.204 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nfnetlink_osf.ko 2020-11-20T12:05:48.204 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nfnetlink_queue.ko 2020-11-20T12:05:48.205 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_chain_nat.ko 2020-11-20T12:05:48.205 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_compat.ko 2020-11-20T12:05:48.205 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_counter.ko 2020-11-20T12:05:48.205 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_ct.ko 2020-11-20T12:05:48.205 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_dup_netdev.ko 2020-11-20T12:05:48.206 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_fib.ko 2020-11-20T12:05:48.206 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_fwd_netdev.ko 2020-11-20T12:05:48.206 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_hash.ko 2020-11-20T12:05:48.206 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_limit.ko 2020-11-20T12:05:48.206 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_log.ko 2020-11-20T12:05:48.207 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_masq.ko 2020-11-20T12:05:48.207 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_nat.ko 2020-11-20T12:05:48.207 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_numgen.ko 2020-11-20T12:05:48.207 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_objref.ko 2020-11-20T12:05:48.207 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_queue.ko 2020-11-20T12:05:48.208 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_quota.ko 2020-11-20T12:05:48.208 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_redir.ko 2020-11-20T12:05:48.208 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_reject.ko 2020-11-20T12:05:48.208 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_reject_inet.ko 2020-11-20T12:05:48.208 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_socket.ko 2020-11-20T12:05:48.209 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/nft_tunnel.ko 2020-11-20T12:05:48.209 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_AUDIT.ko 2020-11-20T12:05:48.209 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_CHECKSUM.ko 2020-11-20T12:05:48.209 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_CLASSIFY.ko 2020-11-20T12:05:48.210 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_CONNSECMARK.ko 2020-11-20T12:05:48.210 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_CT.ko 2020-11-20T12:05:48.210 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_DSCP.ko 2020-11-20T12:05:48.210 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_HL.ko 2020-11-20T12:05:48.210 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_HMARK.ko 2020-11-20T12:05:48.211 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_IDLETIMER.ko 2020-11-20T12:05:48.211 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_LED.ko 2020-11-20T12:05:48.211 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_LOG.ko 2020-11-20T12:05:48.211 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_MASQUERADE.ko 2020-11-20T12:05:48.211 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_NETMAP.ko 2020-11-20T12:05:48.212 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_NFLOG.ko 2020-11-20T12:05:48.212 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_NFQUEUE.ko 2020-11-20T12:05:48.212 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_RATEEST.ko 2020-11-20T12:05:48.212 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_REDIRECT.ko 2020-11-20T12:05:48.212 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_SECMARK.ko 2020-11-20T12:05:48.213 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_TCPMSS.ko 2020-11-20T12:05:48.213 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2020-11-20T12:05:48.213 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_TEE.ko 2020-11-20T12:05:48.213 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_TPROXY.ko 2020-11-20T12:05:48.213 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_TRACE.ko 2020-11-20T12:05:48.214 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_addrtype.ko 2020-11-20T12:05:48.214 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_bpf.ko 2020-11-20T12:05:48.214 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_cgroup.ko 2020-11-20T12:05:48.214 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_cluster.ko 2020-11-20T12:05:48.214 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_comment.ko 2020-11-20T12:05:48.215 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_connbytes.ko 2020-11-20T12:05:48.215 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_connlabel.ko 2020-11-20T12:05:48.215 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_connlimit.ko 2020-11-20T12:05:48.215 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_connmark.ko 2020-11-20T12:05:48.215 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_conntrack.ko 2020-11-20T12:05:48.216 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_cpu.ko 2020-11-20T12:05:48.216 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_dccp.ko 2020-11-20T12:05:48.216 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_devgroup.ko 2020-11-20T12:05:48.216 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_dscp.ko 2020-11-20T12:05:48.216 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_ecn.ko 2020-11-20T12:05:48.217 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_esp.ko 2020-11-20T12:05:48.217 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_hashlimit.ko 2020-11-20T12:05:48.217 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_helper.ko 2020-11-20T12:05:48.217 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_hl.ko 2020-11-20T12:05:48.218 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_ipcomp.ko 2020-11-20T12:05:48.218 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_iprange.ko 2020-11-20T12:05:48.218 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_ipvs.ko 2020-11-20T12:05:48.218 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_l2tp.ko 2020-11-20T12:05:48.218 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_length.ko 2020-11-20T12:05:48.219 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_limit.ko 2020-11-20T12:05:48.219 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_mac.ko 2020-11-20T12:05:48.219 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_mark.ko 2020-11-20T12:05:48.219 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_multiport.ko 2020-11-20T12:05:48.219 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_nat.ko 2020-11-20T12:05:48.220 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_nfacct.ko 2020-11-20T12:05:48.220 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_osf.ko 2020-11-20T12:05:48.220 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_owner.ko 2020-11-20T12:05:48.220 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_physdev.ko 2020-11-20T12:05:48.220 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_pkttype.ko 2020-11-20T12:05:48.221 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_policy.ko 2020-11-20T12:05:48.221 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_quota.ko 2020-11-20T12:05:48.221 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_rateest.ko 2020-11-20T12:05:48.221 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_realm.ko 2020-11-20T12:05:48.221 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_recent.ko 2020-11-20T12:05:48.222 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_sctp.ko 2020-11-20T12:05:48.222 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_set.ko 2020-11-20T12:05:48.222 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_socket.ko 2020-11-20T12:05:48.222 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_state.ko 2020-11-20T12:05:48.222 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_statistic.ko 2020-11-20T12:05:48.223 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_string.ko 2020-11-20T12:05:48.223 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_tcpmss.ko 2020-11-20T12:05:48.223 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_time.ko 2020-11-20T12:05:48.223 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netfilter/xt_u32.ko 2020-11-20T12:05:48.223 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netlink 2020-11-20T12:05:48.224 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/netlink/netlink_diag.ko 2020-11-20T12:05:48.224 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/nsh 2020-11-20T12:05:48.224 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/nsh/nsh.ko 2020-11-20T12:05:48.224 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/openvswitch 2020-11-20T12:05:48.224 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/openvswitch/openvswitch.ko 2020-11-20T12:05:48.225 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/openvswitch/vport-geneve.ko 2020-11-20T12:05:48.225 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/openvswitch/vport-gre.ko 2020-11-20T12:05:48.225 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/openvswitch/vport-vxlan.ko 2020-11-20T12:05:48.225 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/packet 2020-11-20T12:05:48.226 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/packet/af_packet_diag.ko 2020-11-20T12:05:48.226 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/rds 2020-11-20T12:05:48.226 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/rds/rds.ko 2020-11-20T12:05:48.226 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/rds/rds_rdma.ko 2020-11-20T12:05:48.226 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/rds/rds_tcp.ko 2020-11-20T12:05:48.227 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched 2020-11-20T12:05:48.227 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_csum.ko 2020-11-20T12:05:48.227 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_gact.ko 2020-11-20T12:05:48.227 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_ipt.ko 2020-11-20T12:05:48.227 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_mirred.ko 2020-11-20T12:05:48.228 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_nat.ko 2020-11-20T12:05:48.228 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_pedit.ko 2020-11-20T12:05:48.228 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_police.ko 2020-11-20T12:05:48.228 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_simple.ko 2020-11-20T12:05:48.228 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_skbedit.ko 2020-11-20T12:05:48.229 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/act_vlan.ko 2020-11-20T12:05:48.229 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_basic.ko 2020-11-20T12:05:48.229 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_bpf.ko 2020-11-20T12:05:48.229 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_flow.ko 2020-11-20T12:05:48.229 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_fw.ko 2020-11-20T12:05:48.230 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_route.ko 2020-11-20T12:05:48.230 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_rsvp.ko 2020-11-20T12:05:48.230 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_rsvp6.ko 2020-11-20T12:05:48.230 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_tcindex.ko 2020-11-20T12:05:48.230 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/cls_u32.ko 2020-11-20T12:05:48.231 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/em_cmp.ko 2020-11-20T12:05:48.231 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/em_ipset.ko 2020-11-20T12:05:48.231 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/em_meta.ko 2020-11-20T12:05:48.231 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/em_nbyte.ko 2020-11-20T12:05:48.231 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/em_text.ko 2020-11-20T12:05:48.232 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/em_u32.ko 2020-11-20T12:05:48.232 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_cbq.ko 2020-11-20T12:05:48.232 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_choke.ko 2020-11-20T12:05:48.232 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_codel.ko 2020-11-20T12:05:48.233 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_drr.ko 2020-11-20T12:05:48.233 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_dsmark.ko 2020-11-20T12:05:48.233 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_fq.ko 2020-11-20T12:05:48.233 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_gred.ko 2020-11-20T12:05:48.233 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_hfsc.ko 2020-11-20T12:05:48.234 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_hhf.ko 2020-11-20T12:05:48.234 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_htb.ko 2020-11-20T12:05:48.234 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_ingress.ko 2020-11-20T12:05:48.234 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_mqprio.ko 2020-11-20T12:05:48.234 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_multiq.ko 2020-11-20T12:05:48.235 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_netem.ko 2020-11-20T12:05:48.235 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_pie.ko 2020-11-20T12:05:48.235 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_plug.ko 2020-11-20T12:05:48.235 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_prio.ko 2020-11-20T12:05:48.235 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_qfq.ko 2020-11-20T12:05:48.236 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_red.ko 2020-11-20T12:05:48.236 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_sfb.ko 2020-11-20T12:05:48.236 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_sfq.ko 2020-11-20T12:05:48.236 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_tbf.ko 2020-11-20T12:05:48.236 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sched/sch_teql.ko 2020-11-20T12:05:48.237 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sctp 2020-11-20T12:05:48.237 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sctp/sctp.ko 2020-11-20T12:05:48.237 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sctp/sctp_diag.ko 2020-11-20T12:05:48.237 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sunrpc 2020-11-20T12:05:48.237 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sunrpc/auth_gss 2020-11-20T12:05:48.238 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2020-11-20T12:05:48.238 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2020-11-20T12:05:48.238 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sunrpc/sunrpc.ko 2020-11-20T12:05:48.238 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sunrpc/xprtrdma 2020-11-20T12:05:48.238 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2020-11-20T12:05:48.239 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/tipc 2020-11-20T12:05:48.239 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/tipc/diag.ko 2020-11-20T12:05:48.239 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/tipc/tipc.ko 2020-11-20T12:05:48.239 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/unix 2020-11-20T12:05:48.239 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/unix/unix_diag.ko 2020-11-20T12:05:48.240 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/vmw_vsock 2020-11-20T12:05:48.240 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2020-11-20T12:05:48.240 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2020-11-20T12:05:48.240 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/vmw_vsock/vsock.ko 2020-11-20T12:05:48.240 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/vmw_vsock/vsock_diag.ko 2020-11-20T12:05:48.241 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/vmw_vsock/vsock_loopback.ko 2020-11-20T12:05:48.241 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/xfrm 2020-11-20T12:05:48.241 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/net/xfrm/xfrm_ipcomp.ko 2020-11-20T12:05:48.241 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/security 2020-11-20T12:05:48.242 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/security/keys 2020-11-20T12:05:48.242 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/security/keys/encrypted-keys 2020-11-20T12:05:48.242 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2020-11-20T12:05:48.242 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/security/keys/trusted-keys 2020-11-20T12:05:48.242 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/security/keys/trusted-keys/trusted.ko 2020-11-20T12:05:48.243 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/virt 2020-11-20T12:05:48.243 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/virt/lib 2020-11-20T12:05:48.243 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/kernel/virt/lib/irqbypass.ko 2020-11-20T12:05:48.243 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.alias 2020-11-20T12:05:48.243 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.alias.bin 2020-11-20T12:05:48.244 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.builtin 2020-11-20T12:05:48.244 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.builtin.bin 2020-11-20T12:05:48.244 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.builtin.modinfo 2020-11-20T12:05:48.244 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.dep 2020-11-20T12:05:48.244 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.dep.bin 2020-11-20T12:05:48.245 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.devname 2020-11-20T12:05:48.245 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.order 2020-11-20T12:05:48.246 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.softdep 2020-11-20T12:05:48.246 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.symbols 2020-11-20T12:05:48.246 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/5.10.0-rc2-ceph-gac4f7b07f403/modules.symbols.bin 2020-11-20T12:05:48.247 DEBUG:teuthology.task.kernel:get_image_version: 5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:48.247 INFO:teuthology.orchestra.run.smithi160:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2020-11-20T12:05:48.272 INFO:teuthology.orchestra.run.smithi160.stdout:postinstall scriptlet (using /bin/sh): 2020-11-20T12:05:48.273 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-5.10.0-rc2-ceph-gac4f7b07f403 -a -r /boot/System.map-5.10.0-rc2-ceph-gac4f7b07f403 ]; then 2020-11-20T12:05:48.273 INFO:teuthology.orchestra.run.smithi160.stdout:cp /boot/vmlinuz-5.10.0-rc2-ceph-gac4f7b07f403 /boot/.vmlinuz-5.10.0-rc2-ceph-gac4f7b07f403-rpm 2020-11-20T12:05:48.273 INFO:teuthology.orchestra.run.smithi160.stdout:cp /boot/System.map-5.10.0-rc2-ceph-gac4f7b07f403 /boot/.System.map-5.10.0-rc2-ceph-gac4f7b07f403-rpm 2020-11-20T12:05:48.274 INFO:teuthology.orchestra.run.smithi160.stdout:rm -f /boot/vmlinuz-5.10.0-rc2-ceph-gac4f7b07f403 /boot/System.map-5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:48.274 INFO:teuthology.orchestra.run.smithi160.stdout:/sbin/installkernel 5.10.0-rc2-ceph-gac4f7b07f403 /boot/.vmlinuz-5.10.0-rc2-ceph-gac4f7b07f403-rpm /boot/.System.map-5.10.0-rc2-ceph-gac4f7b07f403-rpm 2020-11-20T12:05:48.274 INFO:teuthology.orchestra.run.smithi160.stdout:rm -f /boot/.vmlinuz-5.10.0-rc2-ceph-gac4f7b07f403-rpm /boot/.System.map-5.10.0-rc2-ceph-gac4f7b07f403-rpm 2020-11-20T12:05:48.274 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2020-11-20T12:05:48.275 INFO:teuthology.orchestra.run.smithi160.stdout:preuninstall scriptlet (using /bin/sh): 2020-11-20T12:05:48.275 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2020-11-20T12:05:48.275 INFO:teuthology.orchestra.run.smithi160.stdout:new-kernel-pkg --remove 5.10.0-rc2-ceph-gac4f7b07f403 --rminitrd --initrdfile=/boot/initramfs-5.10.0-rc2-ceph-gac4f7b07f403.img 2020-11-20T12:05:48.276 INFO:teuthology.orchestra.run.smithi160.stdout:elif [ -x /usr/bin/kernel-install ]; then 2020-11-20T12:05:48.276 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-install remove 5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:48.276 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2020-11-20T12:05:48.276 INFO:teuthology.orchestra.run.smithi160.stdout:postuninstall scriptlet (using /bin/sh): 2020-11-20T12:05:48.276 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /sbin/update-bootloader ]; then 2020-11-20T12:05:48.277 INFO:teuthology.orchestra.run.smithi160.stdout:/sbin/update-bootloader --remove 5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:48.277 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2020-11-20T12:05:48.277 INFO:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2020-11-20T12:05:48.352 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2020-11-20T12:05:48.352 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2020-11-20T12:05:48.352 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.02 2020-11-20T12:05:48.353 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 78.el8 2020-11-20T12:05:48.353 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2020-11-20T12:05:48.353 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Sun 15 Nov 2020 12:08:16 PM UTC 2020-11-20T12:05:48.353 INFO:teuthology.orchestra.run.smithi160.stdout:Group : System Environment/Base 2020-11-20T12:05:48.354 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 9192691 2020-11-20T12:05:48.354 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2020-11-20T12:05:48.354 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-11-20T12:05:48.354 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-11-20T12:05:48.355 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-11-20T12:05:48.355 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : kbuilder.bsys.centos.org 2020-11-20T12:05:48.355 INFO:teuthology.orchestra.run.smithi160.stdout:Relocations : (not relocatable) 2020-11-20T12:05:48.355 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : CentOS BuildSystem 2020-11-20T12:05:48.355 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2020-11-20T12:05:48.356 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2020-11-20T12:05:48.356 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2020-11-20T12:05:48.356 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2020-11-20T12:05:48.356 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:05:48.356 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-11-20T12:05:48.357 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2020-11-20T12:05:48.357 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2020-11-20T12:05:48.357 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2020-11-20T12:05:48.357 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:05:48.357 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2020-11-20T12:05:48.358 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-11-20T12:05:48.359 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:48.359 INFO:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-11-20T12:05:52.568 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2020-11-20T12:05:54.618 INFO:teuthology.orchestra.run.smithi160.stderr:done 2020-11-20T12:05:54.621 INFO:teuthology.orchestra.run.smithi160:> mktemp 2020-11-20T12:05:54.642 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.ja6ICnPjKC 2020-11-20T12:05:54.643 INFO:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ja6ICnPjKC 2020-11-20T12:05:54.721 INFO:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.ja6ICnPjKC 2020-11-20T12:05:54.884 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.ja6ICnPjKC is 4KB 2020-11-20T12:05:54.906 INFO:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.ja6ICnPjKC 2020-11-20T12:05:54.920 INFO:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2020-11-20T12:05:54.995 INFO:teuthology.orchestra.run.smithi160.stdout:558cda909eee45cd892f671baf08ec7a-0-rescue.conf 2020-11-20T12:05:54.996 INFO:teuthology.orchestra.run.smithi160.stdout:558cda909eee45cd892f671baf08ec7a-4.18.0-147.el8.x86_64.conf 2020-11-20T12:05:54.996 INFO:teuthology.orchestra.run.smithi160.stdout:558cda909eee45cd892f671baf08ec7a-4.18.0-193.28.1.el8_2.x86_64.conf 2020-11-20T12:05:54.996 INFO:teuthology.orchestra.run.smithi160.stdout:558cda909eee45cd892f671baf08ec7a-5.10.0-rc2-ceph-gac4f7b07f403.conf 2020-11-20T12:05:54.997 INFO:teuthology.orchestra.run.smithi160:> sudo grub2-set-default 558cda909eee45cd892f671baf08ec7a-5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:05:55.138 INFO:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2020-11-20T12:06:25.141 INFO:teuthology.misc:Re-opening connections... 2020-11-20T12:06:25.142 INFO:teuthology.misc:trying to connect to ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:06:25.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:06:25.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:59.829 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2020-11-20T12:06:59.831 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:06:59.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:06:59.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:59.906 INFO:teuthology.orchestra.run.smithi150:> true 2020-11-20T12:07:00.071 DEBUG:teuthology.misc:waited 34.92956209182739 2020-11-20T12:07:01.073 INFO:teuthology.misc:trying to connect to ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:07:01.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:07:01.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:07:04.149 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2020-11-20T12:07:04.154 INFO:teuthology.misc:trying to connect to ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:07:04.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:07:04.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:07:04.226 INFO:teuthology.orchestra.run.smithi134:> true 2020-11-20T12:07:04.388 DEBUG:teuthology.misc:waited 39.24601221084595 2020-11-20T12:07:05.389 INFO:teuthology.misc:trying to connect to ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:07:05.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:07:05.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:05.392 DEBUG:teuthology.orchestra.remote:timed out 2020-11-20T12:08:05.394 DEBUG:teuthology.misc:waited 100.25205063819885 2020-11-20T12:08:06.395 INFO:teuthology.misc:trying to connect to ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:08:06.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:08:06.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:06.846 INFO:teuthology.orchestra.run.smithi160:> true 2020-11-20T12:08:07.425 DEBUG:teuthology.misc:waited 102.28372049331665 2020-11-20T12:08:08.426 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2020-11-20T12:08:08.426 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.10.0-rc2-ceph-gac4f7b07f403"... 2020-11-20T12:08:08.427 INFO:teuthology.orchestra.run.smithi160:> uname -r 2020-11-20T12:08:08.494 INFO:teuthology.orchestra.run.smithi160.stdout:5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:08:08.494 DEBUG:teuthology.task.kernel:current kernel version is 5.10.0-rc2-ceph-gac4f7b07f403 vs 5.10.0-rc2-ceph-gac4f7b07f403 2020-11-20T12:08:08.495 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-11-20T12:08:08.495 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2020-11-20T12:08:09.496 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T12:08:09.502 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T12:08:09.503 INFO:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T12:08:09.506 INFO:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T12:08:09.509 INFO:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T12:08:09.568 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T12:08:09.575 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T12:08:09.589 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T12:08:09.589 INFO:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T12:08:09.592 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T12:08:09.595 INFO:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T12:08:09.667 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T12:08:09.673 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T12:08:09.674 INFO:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T12:08:09.676 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T12:08:09.678 INFO:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T12:08:09.719 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:09.720 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:09.740 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:09.742 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:09.872 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:09.943 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:09.948 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T12:08:09.956 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T12:08:09.957 INFO:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T12:08:09.959 INFO:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T12:08:09.962 INFO:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T12:08:10.070 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T12:08:10.081 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T12:08:10.082 INFO:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T12:08:10.084 INFO:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T12:08:10.087 INFO:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T12:08:10.144 INFO:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:10.225 INFO:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:10.353 INFO:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:10.433 INFO:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:10.538 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:08:10.539 INFO:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:10.588 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:10.662 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:08:10.663 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:08:10.663 INFO:teuthology.orchestra.run.smithi160.stderr:152 bytes copied, 0.000129221 s, 1.2 MB/s 2020-11-20T12:08:10.666 INFO:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:10.703 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:10.763 INFO:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:10.838 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:10.896 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:08:11.247 INFO:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:11.273 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:11.288 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:08:11.288 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:08:11.288 INFO:teuthology.orchestra.run.smithi150.stderr:152 bytes copied, 3.2789e-05 s, 4.6 MB/s 2020-11-20T12:08:11.289 INFO:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:11.335 INFO:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:11.411 INFO:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:11.497 INFO:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:11.550 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:08:11.551 INFO:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:11.608 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:11.622 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:08:11.622 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:08:11.622 INFO:teuthology.orchestra.run.smithi134.stderr:152 bytes copied, 3.2322e-05 s, 4.7 MB/s 2020-11-20T12:08:11.623 INFO:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2020-11-20T12:08:11.666 INFO:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2020-11-20T12:08:11.668 INFO:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2020-11-20T12:08:11.765 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T12:08:11.782 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T12:08:11.842 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T12:08:12.183 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T12:08:12.191 INFO:teuthology.task.internal:Starting timer... 2020-11-20T12:08:12.192 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T12:08:12.207 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T12:08:12.221 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2020-11-20T12:08:12.221 INFO:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2020-11-20T12:08:12.283 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: [ OK ] 2020-11-20T12:08:12.285 INFO:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2020-11-20T12:08:12.345 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: [ OK ] 2020-11-20T12:08:12.346 INFO:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2020-11-20T12:08:12.512 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: [ OK ] 2020-11-20T12:08:12.517 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T12:08:12.518 INFO:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2020-11-20T12:08:12.588 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2020-11-20T12:08:12.590 INFO:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2020-11-20T12:08:12.620 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2020-11-20T12:08:12.620 INFO:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2020-11-20T12:08:12.660 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2020-11-20T12:08:12.661 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi160.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2020-11-20T12:08:12.662 INFO:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T12:08:12.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:08:12.774 INFO:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T12:08:12.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:08:12.817 INFO:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T12:08:12.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:08:12.861 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T12:08:12.862 INFO:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2020-11-20T12:08:12.975 INFO:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2020-11-20T12:08:13.021 INFO:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2020-11-20T12:08:13.069 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T12:08:13.094 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-11-20T12:08:13.095 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T12:08:13.215 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T12:08:13.217 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi160.front.sepia.ceph.com,smithi150.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T12:08:13.745 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T12:08:14.878 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T12:08:17.416 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T12:08:17.439 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:17 +0000 (0:00:00.076) 0:00:00.076 ******* 2020-11-20T12:08:17.451 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:17 +0000 (0:00:00.013) 0:00:00.089 ******* 2020-11-20T12:08:17.465 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:17 +0000 (0:00:00.014) 0:00:00.103 ******* 2020-11-20T12:08:19.969 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi134.front.sepia.ceph.com] 2020-11-20T12:08:20.041 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:02.574) 0:00:02.677 ******* 2020-11-20T12:08:20.094 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] 2020-11-20T12:08:20.138 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] 2020-11-20T12:08:20.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.136) 0:00:02.814 ******* 2020-11-20T12:08:20.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.064) 0:00:02.879 ******* 2020-11-20T12:08:20.351 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:08:20.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.145) 0:00:03.024 ******* 2020-11-20T12:08:20.393 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:08:20.447 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.060) 0:00:03.085 ******* 2020-11-20T12:08:20.578 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:08:20.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.165) 0:00:03.251 ******* 2020-11-20T12:08:20.788 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-20T12:08:20.790 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [smithi134.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T12:08:20.824 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.211) 0:00:03.463 ******* 2020-11-20T12:08:20.854 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.029) 0:00:03.493 ******* 2020-11-20T12:08:20.859 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-20T12:08:20.861 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:20.892 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.038) 0:00:03.531 ******* 2020-11-20T12:08:20.898 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:20.933 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.040) 0:00:03.571 ******* 2020-11-20T12:08:21.034 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-11-20T12:08:21.035 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T12:08:21.074 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.140) 0:00:03.712 ******* 2020-11-20T12:08:21.100 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-20T12:08:21.102 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:21.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.059) 0:00:03.772 ******* 2020-11-20T12:08:21.201 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-20T12:08:21.203 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:21.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.103) 0:00:03.876 ******* 2020-11-20T12:08:21.268 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.031) 0:00:03.907 ******* 2020-11-20T12:08:21.463 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:21.497 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.228) 0:00:04.136 ******* 2020-11-20T12:08:22.048 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-20T12:08:22.050 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874101.28103-40878010329505/source", "state": "file", "uid": 0} changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874101.251794-34426770092943/source", "state": "file", "uid": 0} 2020-11-20T12:08:22.084 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:22 +0000 (0:00:00.586) 0:00:04.722 ******* 2020-11-20T12:08:22.114 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:22 +0000 (0:00:00.030) 0:00:04.752 ******* 2020-11-20T12:08:22.536 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-20T12:08:22.755 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T12:08:22.757 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-11-20T12:08:22.758 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-11-20T12:08:22.760 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874101.5104253-195582168569037/source", "state": "file", "uid": 0} Friday 20 November 2020 12:08:22 +0000 (0:00:00.604) 0:00:05.357 ******* 2020-11-20T12:08:23.147 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2020-11-20T12:08:23.149 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T12:08:23.241 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T12:08:23.249 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T12:08:23.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.714) 0:00:06.072 ******* 2020-11-20T12:08:23.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.030) 0:00:06.102 ******* 2020-11-20T12:08:23.496 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.032) 0:00:06.134 ******* 2020-11-20T12:08:24.162 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi134.front.sepia.ceph.com] 2020-11-20T12:08:24.227 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] 2020-11-20T12:08:24.279 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T12:08:24.280 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.782) 0:00:06.917 ******* 2020-11-20T12:08:24.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.067) 0:00:06.984 ******* 2020-11-20T12:08:24.766 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:24.768 INFO:teuthology.task.ansible.out:TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.172334", "end": "2020-11-20 12:08:24.737695", "rc": 0, "start": "2020-11-20 12:08:24.565361", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:24.772 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.172263", "end": "2020-11-20 12:08:24.743127", "rc": 0, "start": "2020-11-20 12:08:24.570864", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:24.806 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.459) 0:00:07.444 ******* 2020-11-20T12:08:24.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.030) 0:00:07.474 ******* 2020-11-20T12:08:25.012 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T12:08:25.015 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010514", "end": "2020-11-20 12:08:24.989230", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:24.978716", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:25.063 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.226) 0:00:07.701 ******* 2020-11-20T12:08:25.074 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-11-20T12:08:25.077 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] 2020-11-20T12:08:25.082 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.020454", "end": "2020-11-20 12:08:25.032051", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:25.011597", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:25.115 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.052) 0:00:07.754 ******* 2020-11-20T12:08:25.148 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T12:08:25.150 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-11-20T12:08:25.180 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.064) 0:00:07.819 ******* 2020-11-20T12:08:25.212 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.031) 0:00:07.850 ******* 2020-11-20T12:08:25.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.035) 0:00:07.885 ******* 2020-11-20T12:08:25.257 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.288 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.041) 0:00:07.927 ******* 2020-11-20T12:08:25.319 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.030) 0:00:07.958 ******* 2020-11-20T12:08:25.328 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.361 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.040) 0:00:07.998 ******* 2020-11-20T12:08:25.368 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.407 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.047) 0:00:08.046 ******* 2020-11-20T12:08:25.414 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T12:08:25.416 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.052) 0:00:08.098 ******* 2020-11-20T12:08:25.467 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.502 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.042) 0:00:08.141 ******* 2020-11-20T12:08:25.510 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.051) 0:00:08.193 ******* 2020-11-20T12:08:25.563 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.601 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.046) 0:00:08.239 ******* 2020-11-20T12:08:25.608 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-20T12:08:25.610 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi160.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.145702", "end": "2020-11-20 12:08:25.577183", "rc": 0, "start": "2020-11-20 12:08:25.431481", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:25.643 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.042) 0:00:08.281 ******* 2020-11-20T12:08:25.675 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.032) 0:00:08.313 ******* 2020-11-20T12:08:25.683 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.726 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.050) 0:00:08.364 ******* 2020-11-20T12:08:25.732 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:25.734 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.734 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ 2020-11-20T12:08:25.736 INFO:teuthology.task.ansible.out:ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.746 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.747 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.759 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.760 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.771 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.773 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.784 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqK 2020-11-20T12:08:25.785 INFO:teuthology.task.ansible.out:aaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.796 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2020-11-20T12:08:25.797 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.807 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.819 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.821 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ub 2020-11-20T12:08:25.823 INFO:teuthology.task.ansible.out:untu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": { 2020-11-20T12:08:25.824 INFO:teuthology.task.ansible.out:"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.834 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.835 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2020-11-20T12:08:25.837 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+ 2020-11-20T12:08:25.838 INFO:teuthology.task.ansible.out:RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2020-11-20T12:08:25.841 INFO:teuthology.task.ansible.out:: "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.849 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop 2020-11-20T12:08:25.851 INFO:teuthology.task.ansible.out: OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.861 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.862 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.872 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.876 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dic 2020-11-20T12:08:25.878 INFO:teuthology.task.ansible.out:i6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010 2020-11-20T12:08:25.880 INFO:teuthology.task.ansible.out:c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a 2020-11-20T12:08:25.881 INFO:teuthology.task.ansible.out:82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.888 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.890 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.891 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.902 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.903 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.913 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.915 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.926 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.928 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.929 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.941 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.943 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.953 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.955 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.966 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.968 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.969 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.979 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.981 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.982 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2020-11-20T12:08:25.984 INFO:teuthology.task.ansible.out:: "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.993 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.995 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.005 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.006 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.018 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.020 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013466", "end": "2020-11-20 12:08:25.981720", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:25.968254", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:26.058 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.331) 0:00:08.696 ******* 2020-11-20T12:08:26.064 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:26.065 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.066 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.067 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.067 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.067 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "p 2020-11-20T12:08:26.069 INFO:teuthology.task.ansible.out:ritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.070 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d5797936016 2020-11-20T12:08:26.071 INFO:teuthology.task.ansible.out:99af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.072 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e 2020-11-20T12:08:26.074 INFO:teuthology.task.ansible.out:5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.085 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.087 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.088 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': ' 2020-11-20T12:08:26.089 INFO:teuthology.task.ansible.out:ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.090 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd3 2020-11-20T12:08:26.091 INFO:teuthology.task.ansible.out:90302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.092 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.128 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.069) 0:00:08.766 ******* 2020-11-20T12:08:26.134 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.136 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.137 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fed 2020-11-20T12:08:26.138 INFO:teuthology.task.ansible.out:ora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.140 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.140 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.142 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.143 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.143 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item" 2020-11-20T12:08:26.145 INFO:teuthology.task.ansible.out:: {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2020-11-20T12:08:26.147 INFO:teuthology.task.ansible.out:: "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.156 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.158 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.159 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.159 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.160 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reaso 2020-11-20T12:08:26.161 INFO:teuthology.task.ansible.out:n": "Conditional result was False"} 2020-11-20T12:08:26.198 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.070) 0:00:08.837 ******* 2020-11-20T12:08:26.205 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.206 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.206 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.208 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.208 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanj 2020-11-20T12:08:26.210 INFO:teuthology.task.ansible.out:ara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.211 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de 2020-11-20T12:08:26.213 INFO:teuthology.task.ansible.out:3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.222 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.224 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.224 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.224 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": f 2020-11-20T12:08:26.226 INFO:teuthology.task.ansible.out:alse, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.226 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_v 2020-11-20T12:08:26.228 INFO:teuthology.task.ansible.out:ar": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.262 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.063) 0:00:08.900 ******* 2020-11-20T12:08:26.268 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.275 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": 2020-11-20T12:08:26.277 INFO:teuthology.task.ansible.out: "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7 2020-11-20T12:08:26.279 INFO:teuthology.task.ansible.out:be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.285 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.287 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.288 INFO:teuthology.task.ansible.out: skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.290 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.291 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.293 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.295 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.295 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.296 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-11-20T12:08:26.296 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.304 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:26.305 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.306 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'na 2020-11-20T12:08:26.308 INFO:teuthology.task.ansible.out:me': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.309 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.084) 0:00:08.984 ******* 2020-11-20T12:08:26.348 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:26.353 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.355 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.355 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.356 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2Fi 2020-11-20T12:08:26.357 INFO:teuthology.task.ansible.out:vQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.358 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.359 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.360 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.361 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.361 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lS 2020-11-20T12:08:26.363 INFO:teuthology.task.ansible.out:PExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.365 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.366 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.377 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-20T12:08:26.378 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.379 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.379 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.415 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.069) 0:00:09.053 ******* 2020-11-20T12:08:26.422 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.423 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.424 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.435 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.437 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.438 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.438 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": 2020-11-20T12:08:26.439 INFO:teuthology.task.ansible.out:{"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.440 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => 2020-11-20T12:08:26.441 INFO:teuthology.task.ansible.out: (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.442 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.442 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi134.front.sepia.ceph.com] 2020-11-20T12:08:26.444 INFO:teuthology.task.ansible.out: => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.477 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.062) 0:00:09.116 ******* 2020-11-20T12:08:26.484 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.502 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.504 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.505 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2020-11-20T12:08:26.506 INFO:teuthology.task.ansible.out:me": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.062) 0:00:09.179 ******* 2020-11-20T12:08:26.548 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.549 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.550 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.551 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.552 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.553 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.553 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'dmic 2020-11-20T12:08:26.555 INFO:teuthology.task.ansible.out:k', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.572 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.574 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.574 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T12:08:26.574 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2 2020-11-20T12:08:26.576 INFO:teuthology.task.ansible.out:g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.071) 0:00:09.250 ******* 2020-11-20T12:08:26.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.049) 0:00:09.300 ******* 2020-11-20T12:08:26.668 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.670 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.671 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIw 2020-11-20T12:08:26.672 INFO:teuthology.task.ansible.out:AAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d6932535 2020-11-20T12:08:26.674 INFO:teuthology.task.ansible.out:11d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY 2020-11-20T12:08:26.677 INFO:teuthology.task.ansible.out:1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reaso 2020-11-20T12:08:26.678 INFO:teuthology.task.ansible.out:n": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item 2020-11-20T12:08:26.680 INFO:teuthology.task.ansible.out:": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c 2020-11-20T12:08:26.682 INFO:teuthology.task.ansible.out:1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** 2020-11-20T12:08:26.733 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.071) 0:00:09.371 ******* 2020-11-20T12:08:26.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.034) 0:00:09.405 ******* 2020-11-20T12:08:26.775 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:26.777 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2 2020-11-20T12:08:26.779 INFO:teuthology.task.ansible.out:794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.779 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => 2020-11-20T12:08:26.781 INFO:teuthology.task.ansible.out: {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:26.781 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False 2020-11-20T12:08:26.783 INFO:teuthology.task.ansible.out:"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.785 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "a 2020-11-20T12:08:26.786 INFO:teuthology.task.ansible.out:bhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.823 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.055) 0:00:09.461 ******* 2020-11-20T12:08:26.830 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.832 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.832 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.834 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.875 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.052) 0:00:09.513 ******* 2020-11-20T12:08:26.882 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.883 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.884 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T12:08:26.884 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.885 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item 2020-11-20T12:08:26.886 INFO:teuthology.task.ansible.out:", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.888 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.889 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.889 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 2020-11-20T12:08:26.891 INFO:teuthology.task.ansible.out: f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.048) 0:00:09.562 ******* 2020-11-20T12:08:26.930 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.931 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.932 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-11-20T12:08:26.933 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.935 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:26.936 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.937 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.938 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", 2020-11-20T12:08:26.940 INFO:teuthology.task.ansible.out:"ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.971 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.047) 0:00:09.610 ******* 2020-11-20T12:08:26.979 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.980 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.981 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.981 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional resul 2020-11-20T12:08:26.983 INFO:teuthology.task.ansible.out:t was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.023 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.051) 0:00:09.661 ******* 2020-11-20T12:08:27.030 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.032 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.032 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.032 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:27.034 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.034 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f9 2020-11-20T12:08:27.036 INFO:teuthology.task.ansible.out:97d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.074 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.051) 0:00:09.713 ******* 2020-11-20T12:08:27.081 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.083 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.085 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.085 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.086 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (i 2020-11-20T12:08:27.087 INFO:teuthology.task.ansible.out:tem={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.121 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.046) 0:00:09.759 ******* 2020-11-20T12:08:27.129 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.131 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.131 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.133 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.134 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.171 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.049) 0:00:09.809 ******* 2020-11-20T12:08:27.178 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.179 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.181 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:27.182 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.182 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was Fa 2020-11-20T12:08:27.184 INFO:teuthology.task.ansible.out:lse"} skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.184 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.184 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.185 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.186 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.187 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.199 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T12:08:27.201 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.201 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T12:08:27.202 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.202 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T12:08:27.202 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.205 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ******************** 2020-11-20T12:08:27.206 INFO:teuthology.task.ansible.out:**** skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.241 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.070) 0:00:09.879 ******* 2020-11-20T12:08:27.248 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T12:08:27.250 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.250 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:27.251 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.251 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.251 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:27.252 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_v 2020-11-20T12:08:27.253 INFO:teuthology.task.ansible.out:ar": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.254 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:27.254 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.255 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=pmcgarry) => 2020-11-20T12:08:27.256 INFO:teuthology.task.ansible.out:{"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.256 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.257 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=r 2020-11-20T12:08:27.258 INFO:teuthology.task.ansible.out:yneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.270 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.272 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi150.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.283 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:27.284 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.285 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:27.285 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.303 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T12:08:27.305 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.343 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.101) 0:00:09.981 ******* 2020-11-20T12:08:27.349 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.350 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.350 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.352 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.354 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.355 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.357 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.358 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.359 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.359 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.360 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.360 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.360 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.361 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.361 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.362 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.362 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.363 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** TASK [users : Remove revoked users] ******************************************** skipping: [smithi150.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.400 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.056) 0:00:10.038 ******* 2020-11-20T12:08:27.407 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.408 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.409 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.409 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.410 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.410 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.411 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.412 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.413 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (it 2020-11-20T12:08:27.415 INFO:teuthology.task.ansible.out:em=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.426 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.428 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.428 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T12:08:27.429 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.430 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.431 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.481 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.081) 0:00:10.120 ******* 2020-11-20T12:08:27.488 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.493 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.495 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.496 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.496 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.496 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.497 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.497 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.536 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.054) 0:00:10.175 ******* 2020-11-20T12:08:27.544 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.545 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.547 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi150.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.548 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.549 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.549 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.606 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.068) 0:00:10.243 ******* 2020-11-20T12:08:27.623 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.626 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.676 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.068) 0:00:10.312 ******* 2020-11-20T12:08:27.817 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:08:27 +0000 (0:00:00.053) 0:00:10.366 ******* TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:08:27 +0000 (0:00:00.084) 0:00:10.451 ******* 2020-11-20T12:08:27.846 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T12:08:27.848 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.903 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.090) 0:00:10.542 ******* 2020-11-20T12:08:27.941 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T12:08:27.943 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.954 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.965 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.976 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.978 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.988 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.989 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.991 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.002 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.004 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.014 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.015 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.026 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.027 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.037 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.049 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.049 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.062 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.063 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.064 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.064 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.075 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.086 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.088 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.099 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.100 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.111 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.112 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.122 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.124 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.134 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.138 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.146 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.148 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.159 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.161 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.172 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.172 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.174 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.185 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.186 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.197 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.337) 0:00:10.879 ******* 2020-11-20T12:08:28.299 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T12:08:28.300 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T12:08:28.335 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.094) 0:00:10.973 ******* 2020-11-20T12:08:28.369 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.034) 0:00:11.008 ******* 2020-11-20T12:08:28.376 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi134.front.sepia.ceph.com] => { "msg": "Host smithi134.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-11-20T12:08:28.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:11.049 ******* 2020-11-20T12:08:28.417 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => { "msg": "Host smithi150.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-11-20T12:08:28.452 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:11.090 ******* 2020-11-20T12:08:28.459 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T12:08:28.461 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-11-20T12:08:28.503 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.051) 0:00:11.142 ******* 2020-11-20T12:08:28.511 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-11-20T12:08:28.545 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:11.183 ******* 2020-11-20T12:08:28.551 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T12:08:28.553 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.587 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.042) 0:00:11.226 ******* 2020-11-20T12:08:28.595 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.043) 0:00:11.269 ******* 2020-11-20T12:08:29.073 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.293494", "end": "2020-11-20 12:08:29.048940", "rc": 0, "start": "2020-11-20 12:08:28.755446", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T12:08:29.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.475) 0:00:11.745 ******* 2020-11-20T12:08:29.135 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.168 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.061) 0:00:11.806 ******* 2020-11-20T12:08:29.175 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T12:08:29.176 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.330642", "end": "2020-11-20 12:08:29.137358", "rc": 0, "start": "2020-11-20 12:08:28.806716", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T12:08:29.178 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T12:08:29.178 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T12:08:29.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.043) 0:00:11.850 ******* 2020-11-20T12:08:29.242 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.030) 0:00:11.881 ******* 2020-11-20T12:08:29.248 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T12:08:29.251 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.284 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.041) 0:00:11.923 ******* 2020-11-20T12:08:29.315 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.030) 0:00:11.953 ******* 2020-11-20T12:08:29.321 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T12:08:29.324 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => { "msg": "Host smithi160.front.sepia.ceph.com is running CentOS 8.1 (Core)" } TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.355 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.040) 0:00:11.993 ******* 2020-11-20T12:08:29.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.032) 0:00:12.026 ******* 2020-11-20T12:08:29.393 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T12:08:29.395 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.040) 0:00:12.067 ******* 2020-11-20T12:08:29.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.033) 0:00:12.100 ******* 2020-11-20T12:08:29.468 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T12:08:29.470 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.045) 0:00:12.146 ******* 2020-11-20T12:08:29.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.032) 0:00:12.178 ******* 2020-11-20T12:08:29.546 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T12:08:29.548 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.043) 0:00:12.221 ******* 2020-11-20T12:08:29.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.030) 0:00:12.252 ******* 2020-11-20T12:08:29.621 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T12:08:29.623 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi134.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:29.658 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.043) 0:00:12.296 ******* 2020-11-20T12:08:29.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.032) 0:00:12.329 ******* 2020-11-20T12:08:29.697 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T12:08:29.698 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.733 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.042) 0:00:12.371 ******* 2020-11-20T12:08:29.766 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.032) 0:00:12.404 ******* 2020-11-20T12:08:29.773 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T12:08:29.775 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.045) 0:00:12.450 ******* 2020-11-20T12:08:29.818 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T12:08:29.820 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.858 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.046) 0:00:12.497 ******* 2020-11-20T12:08:29.866 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T12:08:29.868 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:29.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.050) 0:00:12.547 ******* 2020-11-20T12:08:29.917 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T12:08:29.920 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.960 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.051) 0:00:12.598 ******* 2020-11-20T12:08:29.968 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T12:08:29.970 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.013 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.053) 0:00:12.652 ******* 2020-11-20T12:08:30.021 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T12:08:30.023 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:30.066 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.053) 0:00:12.705 ******* 2020-11-20T12:08:30.074 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T12:08:30.076 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:30.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.043) 0:00:12.749 ******* 2020-11-20T12:08:30.117 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T12:08:30.118 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.151 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.040) 0:00:12.789 ******* 2020-11-20T12:08:30.157 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T12:08:30.159 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.050) 0:00:12.840 ******* 2020-11-20T12:08:30.209 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T12:08:30.212 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.245 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.043) 0:00:12.883 ******* 2020-11-20T12:08:30.251 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T12:08:30.253 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.286 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:12.925 ******* 2020-11-20T12:08:30.293 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T12:08:30.295 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:30.331 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.044) 0:00:12.969 ******* 2020-11-20T12:08:30.337 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T12:08:30.341 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.372 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.010 ******* 2020-11-20T12:08:30.380 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T12:08:30.381 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.052 ******* 2020-11-20T12:08:30.421 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T12:08:30.424 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.456 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.094 ******* 2020-11-20T12:08:30.462 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T12:08:30.464 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:30.496 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.040) 0:00:13.134 ******* 2020-11-20T12:08:30.502 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T12:08:30.504 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:30.538 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.176 ******* 2020-11-20T12:08:30.544 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T12:08:30.546 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.217 ******* 2020-11-20T12:08:30.585 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T12:08:30.589 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.518840", "end": "2020-11-20 12:08:30.512514", "rc": 0, "start": "2020-11-20 12:08:29.993674", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Clean yum cache] ************************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.620 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.258 ******* 2020-11-20T12:08:30.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.033) 0:00:13.292 ******* 2020-11-20T12:08:30.660 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T12:08:30.662 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.040) 0:00:13.333 ******* 2020-11-20T12:08:30.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.031) 0:00:13.364 ******* 2020-11-20T12:08:30.732 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.734 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.766 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.405 ******* 2020-11-20T12:08:30.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.031) 0:00:13.436 ******* 2020-11-20T12:08:30.803 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T12:08:30.805 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.839 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.040) 0:00:13.477 ******* 2020-11-20T12:08:30.874 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.035) 0:00:13.512 ******* 2020-11-20T12:08:30.881 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T12:08:30.882 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.041) 0:00:13.554 ******* 2020-11-20T12:08:30.946 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.030) 0:00:13.585 ******* 2020-11-20T12:08:30.951 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T12:08:30.953 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:30.986 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.039) 0:00:13.624 ******* 2020-11-20T12:08:31.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.030) 0:00:13.654 ******* 2020-11-20T12:08:31.022 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T12:08:31.023 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:31.058 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.042) 0:00:13.697 ******* 2020-11-20T12:08:31.090 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.031) 0:00:13.728 ******* 2020-11-20T12:08:31.096 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T12:08:31.098 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.041) 0:00:13.770 ******* 2020-11-20T12:08:31.162 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.030) 0:00:13.800 ******* 2020-11-20T12:08:31.168 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T12:08:31.170 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.202 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.040) 0:00:13.841 ******* 2020-11-20T12:08:31.234 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.031) 0:00:13.872 ******* 2020-11-20T12:08:31.240 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:08:31.241 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.275 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.041) 0:00:13.914 ******* 2020-11-20T12:08:31.282 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T12:08:31.284 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.317 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.041) 0:00:13.955 ******* 2020-11-20T12:08:31.324 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T12:08:31.325 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.041) 0:00:13.996 ******* 2020-11-20T12:08:31.363 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T12:08:31.365 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.401 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.043) 0:00:14.040 ******* 2020-11-20T12:08:31.407 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T12:08:31.409 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.444 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.043) 0:00:14.083 ******* 2020-11-20T12:08:31.452 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:31.453 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi160.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi160.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:31.487 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.042) 0:00:14.125 ******* 2020-11-20T12:08:31.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.030) 0:00:14.156 ******* 2020-11-20T12:08:31.524 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T12:08:31.526 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.561 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.043) 0:00:14.199 ******* 2020-11-20T12:08:31.568 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T12:08:31.569 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.606 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.045) 0:00:14.245 ******* 2020-11-20T12:08:31.613 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T12:08:31.615 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.649 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.042) 0:00:14.287 ******* 2020-11-20T12:08:31.656 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T12:08:31.658 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.042) 0:00:14.330 ******* 2020-11-20T12:08:31.698 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T12:08:31.699 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.042) 0:00:14.372 ******* 2020-11-20T12:08:31.740 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T12:08:31.742 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:31.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.046) 0:00:14.419 ******* 2020-11-20T12:08:31.786 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T12:08:31.787 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:31.821 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.040) 0:00:14.459 ******* 2020-11-20T12:08:31.827 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T12:08:31.829 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.042) 0:00:14.502 ******* 2020-11-20T12:08:31.869 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T12:08:31.871 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.904 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.041) 0:00:14.543 ******* 2020-11-20T12:08:31.911 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T12:08:31.912 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:31.946 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.041) 0:00:14.585 ******* 2020-11-20T12:08:31.952 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T12:08:31.954 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:31.988 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:31 +0000 (0:00:00.041) 0:00:14.626 ******* 2020-11-20T12:08:31.995 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:08:31.996 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.043) 0:00:14.670 ******* 2020-11-20T12:08:32.058 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T12:08:32.059 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.092 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.060) 0:00:14.730 ******* 2020-11-20T12:08:32.118 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T12:08:32.120 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.153 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.060) 0:00:14.791 ******* 2020-11-20T12:08:32.179 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T12:08:32.182 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.060) 0:00:14.852 ******* 2020-11-20T12:08:32.230 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T12:08:32.232 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:32.265 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.051) 0:00:14.903 ******* 2020-11-20T12:08:32.272 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T12:08:32.273 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:32.307 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.042) 0:00:14.945 ******* 2020-11-20T12:08:32.344 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.073) 0:00:15.019 ******* 2020-11-20T12:08:32.398 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:08:32.399 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T12:08:32.436 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.054) 0:00:15.074 ******* 2020-11-20T12:08:32.444 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T12:08:32.446 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.043) 0:00:15.118 ******* 2020-11-20T12:08:32.506 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T12:08:32.508 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.060) 0:00:15.178 ******* 2020-11-20T12:08:32.566 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T12:08:32.568 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.060) 0:00:15.239 ******* 2020-11-20T12:08:32.638 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T12:08:32.640 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.676 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.075) 0:00:15.315 ******* 2020-11-20T12:08:32.703 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T12:08:32.705 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.743 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.066) 0:00:15.381 ******* 2020-11-20T12:08:32.749 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:08:32.750 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T12:08:32.772 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T12:08:32.774 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:32.806 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.063) 0:00:15.444 ******* 2020-11-20T12:08:32.833 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T12:08:32.835 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.065) 0:00:15.510 ******* 2020-11-20T12:08:32.898 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T12:08:32.900 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:32.933 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:32 +0000 (0:00:00.060) 0:00:15.571 ******* 2020-11-20T12:08:32.940 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T12:08:32.941 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T12:08:33.187 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:08:33.188 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T12:08:33.224 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.290) 0:00:15.862 ******* 2020-11-20T12:08:33.307 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T12:08:33.308 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:33.351 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.127) 0:00:15.990 ******* 2020-11-20T12:08:33.368 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T12:08:33.516 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} Friday 20 November 2020 12:08:33 +0000 (0:00:00.053) 0:00:16.043 ******* TASK [common : Clean yum cache] ************************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:08:33 +0000 (0:00:00.084) 0:00:16.128 ******* 2020-11-20T12:08:33.518 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:08:33.520 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:33.557 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.066) 0:00:16.195 ******* 2020-11-20T12:08:33.585 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T12:08:33.587 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:33.621 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.064) 0:00:16.259 ******* 2020-11-20T12:08:33.662 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T12:08:33.664 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:33.716 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.095) 0:00:16.354 ******* 2020-11-20T12:08:33.725 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T12:08:33.727 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T12:08:33.739 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:33.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.064) 0:00:16.419 ******* 2020-11-20T12:08:33.808 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:33.845 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.064) 0:00:16.484 ******* 2020-11-20T12:08:33.873 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T12:08:33.875 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:33.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.070) 0:00:16.554 ******* 2020-11-20T12:08:33.943 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:33.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:33 +0000 (0:00:00.060) 0:00:16.615 ******* 2020-11-20T12:08:34.003 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T12:08:34.005 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.059) 0:00:16.675 ******* 2020-11-20T12:08:34.160 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T12:08:34.162 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T12:08:34.197 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.160) 0:00:16.835 ******* 2020-11-20T12:08:34.226 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:08:34.227 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.259 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.061) 0:00:16.897 ******* 2020-11-20T12:08:34.286 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:08:34.288 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.321 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.061) 0:00:16.959 ******* 2020-11-20T12:08:34.337 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:08:34.339 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T12:08:34.350 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.066) 0:00:17.026 ******* 2020-11-20T12:08:34.418 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.455 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.067) 0:00:17.094 ******* 2020-11-20T12:08:34.484 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:08:34.486 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.069) 0:00:17.163 ******* 2020-11-20T12:08:34.532 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T12:08:34.534 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.298798", "end": "2020-11-20 12:08:34.500343", "rc": 0, "start": "2020-11-20 12:08:34.201545", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:08:34.579 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.053) 0:00:17.217 ******* 2020-11-20T12:08:34.588 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T12:08:34.590 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.623 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.043) 0:00:17.261 ******* 2020-11-20T12:08:34.651 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T12:08:34.652 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.061) 0:00:17.323 ******* 2020-11-20T12:08:34.713 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.752 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.067) 0:00:17.391 ******* 2020-11-20T12:08:34.786 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T12:08:34.788 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:34.829 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.077) 0:00:17.468 ******* 2020-11-20T12:08:35.274 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:08:35.277 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T12:08:35.312 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:35 +0000 (0:00:00.482) 0:00:17.950 ******* 2020-11-20T12:08:35.520 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T12:08:35.522 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.499497", "end": "2020-11-20 12:08:35.500338", "rc": 0, "start": "2020-11-20 12:08:35.000841", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:08:35.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:35 +0000 (0:00:00.244) 0:00:18.195 ******* 2020-11-20T12:08:36.285 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-11-20T12:08:36.287 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T12:08:37.194 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T12:08:37.230 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:01.673) 0:00:19.868 ******* 2020-11-20T12:08:37.257 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:08:37.259 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.060) 0:00:19.929 ******* 2020-11-20T12:08:37.317 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:08:37.319 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.351 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.059) 0:00:19.989 ******* 2020-11-20T12:08:37.377 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-11-20T12:08:37.379 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.062) 0:00:20.052 ******* 2020-11-20T12:08:37.440 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T12:08:37.441 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.474 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.060) 0:00:20.113 ******* 2020-11-20T12:08:37.501 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.536 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.062) 0:00:20.175 ******* 2020-11-20T12:08:37.563 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T12:08:37.565 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.062) 0:00:20.237 ******* 2020-11-20T12:08:37.625 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T12:08:37.627 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.060) 0:00:20.298 ******* 2020-11-20T12:08:37.687 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T12:08:37.688 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.066) 0:00:20.364 ******* 2020-11-20T12:08:37.753 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T12:08:37.755 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:37.787 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:37 +0000 (0:00:00.061) 0:00:20.426 ******* 2020-11-20T12:08:38.541 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.421891", "end": "2020-11-20 12:08:38.501043", "rc": 0, "start": "2020-11-20 12:08:38.079152", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:08:38.576 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:38 +0000 (0:00:00.788) 0:00:21.214 ******* 2020-11-20T12:08:41.886 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T12:08:41.888 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T12:08:41.922 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:41 +0000 (0:00:03.346) 0:00:24.560 ******* 2020-11-20T12:08:41.950 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T12:08:41.951 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:41.983 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:41 +0000 (0:00:00.061) 0:00:24.622 ******* 2020-11-20T12:08:42.011 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T12:08:42.013 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.048 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.064) 0:00:24.686 ******* 2020-11-20T12:08:42.076 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.116 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.067) 0:00:24.754 ******* 2020-11-20T12:08:42.143 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T12:08:42.145 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.178 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.061) 0:00:24.816 ******* 2020-11-20T12:08:42.500 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T12:08:42.502 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T12:08:42.536 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.358) 0:00:25.175 ******* 2020-11-20T12:08:42.563 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T12:08:42.565 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.060) 0:00:25.235 ******* 2020-11-20T12:08:42.603 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T12:08:42.605 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T12:08:42.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.044) 0:00:25.279 ******* 2020-11-20T12:08:42.648 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T12:08:42.649 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add krb5 config file] ******************************************* 2020-11-20T12:08:42.650 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T12:08:42.683 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.042) 0:00:25.321 ******* 2020-11-20T12:08:42.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.032) 0:00:25.354 ******* 2020-11-20T12:08:42.721 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T12:08:42.723 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.044) 0:00:25.398 ******* 2020-11-20T12:08:42.767 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T12:08:42.768 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.041) 0:00:25.440 ******* 2020-11-20T12:08:42.808 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T12:08:42.810 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.843 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.041) 0:00:25.481 ******* 2020-11-20T12:08:42.849 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T12:08:42.851 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.040) 0:00:25.522 ******* 2020-11-20T12:08:42.890 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T12:08:42.892 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.927 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.042) 0:00:25.565 ******* 2020-11-20T12:08:42.959 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T12:08:42.960 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:42.992 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:42 +0000 (0:00:00.065) 0:00:25.631 ******* 2020-11-20T12:08:43.455 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T12:08:43.495 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} Friday 20 November 2020 12:08:43 +0000 (0:00:00.498) 0:00:26.129 ******* 2020-11-20T12:08:43.807 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T12:08:43.845 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:43 +0000 (0:00:00.354) 0:00:26.483 ******* 2020-11-20T12:08:45.976 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T12:08:45.978 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T12:08:46.021 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:02.176) 0:00:28.660 ******* 2020-11-20T12:08:46.547 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:08:46.549 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T12:08:46.663 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T12:08:46.665 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T12:08:46.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:00.676) 0:00:29.336 ******* 2020-11-20T12:08:47.051 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:08:47.053 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T12:08:47.232 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T12:08:47.516 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T12:08:47.556 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:47 +0000 (0:00:00.858) 0:00:30.194 ******* 2020-11-20T12:08:47.721 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T12:08:47.744 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T12:08:47.746 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:08:47.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:47 +0000 (0:00:00.222) 0:00:30.416 ******* 2020-11-20T12:08:48.186 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi150.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T12:08:48.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:48 +0000 (0:00:00.443) 0:00:30.860 ******* 2020-11-20T12:08:48.249 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:48.267 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi134.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T12:08:48.441 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T12:08:48.443 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:08:48.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:48 +0000 (0:00:00.253) 0:00:31.113 ******* 2020-11-20T12:08:48.705 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T12:08:48.706 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2020-11-20T12:08:48.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:48 +0000 (0:00:00.272) 0:00:31.385 ******* 2020-11-20T12:08:48.784 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:08:48.786 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T12:08:48.966 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T12:08:49.219 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T12:08:49.255 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.508) 0:00:31.893 ******* 2020-11-20T12:08:49.283 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T12:08:49.284 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:49.317 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.061) 0:00:31.955 ******* 2020-11-20T12:08:49.357 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T12:08:49.358 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T12:08:49.391 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.074) 0:00:32.030 ******* 2020-11-20T12:08:49.400 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi150.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T12:08:49.584 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:49.653 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.260) 0:00:32.290 ******* 2020-11-20T12:08:49.664 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:08:49.667 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T12:08:49.699 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T12:08:49.702 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:49.711 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:49.722 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:49.724 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:49.758 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.106) 0:00:32.397 ******* 2020-11-20T12:08:49.855 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:08:49.857 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T12:08:49.904 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.143) 0:00:32.541 ******* 2020-11-20T12:08:49.930 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:49.963 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.060) 0:00:32.602 ******* 2020-11-20T12:08:50.012 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T12:08:50.014 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T12:08:50.045 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.081) 0:00:32.684 ******* 2020-11-20T12:08:50.243 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T12:08:50.244 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:50.277 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.231) 0:00:32.915 ******* 2020-11-20T12:08:50.324 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T12:08:50.326 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.336 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.337 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.347 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.104) 0:00:33.020 ******* 2020-11-20T12:08:50.533 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:08:50.534 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T12:08:50.700 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T12:08:50.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.364) 0:00:33.384 ******* 2020-11-20T12:08:50.779 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.064) 0:00:33.449 ******* 2020-11-20T12:08:51.295 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T12:08:51.328 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.517) 0:00:33.967 ******* 2020-11-20T12:08:51.355 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T12:08:51.357 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T12:08:51.403 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.073) 0:00:34.040 ******* 2020-11-20T12:08:51.436 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T12:08:51.437 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:51.471 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.068) 0:00:34.109 ******* 2020-11-20T12:08:51.477 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:08:51.479 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T12:08:51.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.052) 0:00:34.161 ******* 2020-11-20T12:08:51.792 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T12:08:51.794 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T12:08:51.828 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.304) 0:00:34.466 ******* 2020-11-20T12:08:51.872 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi134.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:51.905 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.077) 0:00:34.543 ******* 2020-11-20T12:08:51.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.031) 0:00:34.575 ******* 2020-11-20T12:08:51.976 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T12:08:51.977 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T12:08:52.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.086) 0:00:34.662 ******* 2020-11-20T12:08:52.107 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T12:08:52.108 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:52.144 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.120) 0:00:34.782 ******* 2020-11-20T12:08:52.386 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T12:08:52.388 INFO:teuthology.task.ansible.out:fatal: [smithi134.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T12:08:52.421 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.277) 0:00:35.059 ******* 2020-11-20T12:08:52.458 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:52.497 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.076) 0:00:35.136 ******* 2020-11-20T12:08:52.514 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:52.515 INFO:teuthology.task.ansible.out:TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T12:08:52.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.053) 0:00:35.189 ******* 2020-11-20T12:08:52.601 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T12:08:52.603 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:52.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.084) 0:00:35.274 ******* 2020-11-20T12:08:52.824 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:08:52.826 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T12:08:52.847 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T12:08:52.849 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:52.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.252) 0:00:35.527 ******* 2020-11-20T12:08:52.961 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T12:08:52.962 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T12:08:53.011 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.122) 0:00:35.649 ******* 2020-11-20T12:08:53.146 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T12:08:53.194 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.182) 0:00:35.832 ******* 2020-11-20T12:08:53.237 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:53.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.095) 0:00:35.928 ******* 2020-11-20T12:08:53.727 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:08:53.729 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T12:08:53.782 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T12:08:53.785 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T12:08:53.826 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.536) 0:00:36.465 ******* 2020-11-20T12:08:53.836 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T12:08:53.838 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:03:20 UTC", "ActiveEnterTimestampMonotonic": "16288759", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target sysinit.target tmp.mount systemd-journald.socket system.slice var-run.mount network.target -.mount nss-lookup.target local-fs.target systemd-tmpfiles-setup.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:03:20 UTC", "AssertTimestampMonotonic": "16287918", "Before": "xdm.service multi-user.target plymouth-quit.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:03:20 UTC", "ConditionTimestampMonotonic": "16287918", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-11-20T12:08:53.840 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2501", "ExecMainStartTimestamp": "Fri 2020-11-20 12:03:20 UTC", "ExecMainStartTimestampMonotonic": "16288730", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:03:20 UTC", "InactiveExitTimestampMonotonic": "16288759", "InvocationID": "ae821f84e6b046a38b077d54904eb52f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitD 2020-11-20T12:08:53.842 INFO:teuthology.task.ansible.out:ATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2501", "MemoryAccounting": "yes", "MemoryCurrent": "1228800", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode 2020-11-20T12:08:53.844 INFO:teuthology.task.ansible.out:": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:03:20 UTC", "StateChangeTimestampMonotonic": "16288759", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:03:20 UTC", "WatchdogTimestampMonotonic": "16288759", "WatchdogUSec": "0"}} 2020-11-20T12:08:53.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.055) 0:00:36.520 ******* 2020-11-20T12:08:54.080 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T12:08:54.082 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001613", "end": "2020-11-20 12:08:54.052119", "rc": 0, "start": "2020-11-20 12:08:54.050506", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T12:08:54.128 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.246) 0:00:36.767 ******* 2020-11-20T12:08:54.149 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T12:08:54.150 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:03:32 UTC", "ActiveEnterTimestampMonotonic": "15890216", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket var-run.mount time-sync.target -.mount system.slice network.target local-fs.target nss-lookup.target tmp.mount basic.target systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:03:32 UTC", "AssertTimestampMonotonic": "15889458", "Before": "shutdown.target multi-user.target xdm.service plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:03:32 UTC", "ConditionTimestampMonotonic": "15889456", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-11-20T12:08:54.151 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2501", "ExecMainStartTimestamp": "Fri 2020-11-20 12:03:32 UTC", "ExecMainStartTimestampMonotonic": "15890190", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:03:32 UTC", "InactiveExitTimestampMonotonic": "15890216", "InvocationID": "3c5aaea976244e02921e9359910f7683", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitD 2020-11-20T12:08:54.153 INFO:teuthology.task.ansible.out:ATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2501", "MemoryAccounting": "yes", "MemoryCurrent": "1302528", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode 2020-11-20T12:08:54.155 INFO:teuthology.task.ansible.out:": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:03:32 UTC", "StateChangeTimestampMonotonic": "15890216", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:03:32 UTC", "WatchdogTimestampMonotonic": "15890216", "WatchdogUSec": "0"}} 2020-11-20T12:08:54.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.057) 0:00:36.824 ******* 2020-11-20T12:08:54.385 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T12:08:54.387 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001641", "end": "2020-11-20 12:08:54.365110", "rc": 0, "start": "2020-11-20 12:08:54.363469", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T12:08:54.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.247) 0:00:37.072 ******* 2020-11-20T12:08:54.741 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi160.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T12:08:54.776 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.342) 0:00:37.415 ******* 2020-11-20T12:08:54.803 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T12:08:54.805 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:54.838 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.061) 0:00:37.476 ******* 2020-11-20T12:08:54.876 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T12:08:54.878 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T12:08:54.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.071) 0:00:37.548 ******* 2020-11-20T12:08:55.045 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T12:08:55.047 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T12:08:55.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:55 +0000 (0:00:00.170) 0:00:37.718 ******* 2020-11-20T12:08:55.266 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T12:08:55.268 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:55.320 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:55 +0000 (0:00:00.240) 0:00:37.958 ******* 2020-11-20T12:08:55.359 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T12:08:55.360 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:55.370 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:55.396 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:55.397 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:55.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:55 +0000 (0:00:00.113) 0:00:38.072 ******* 2020-11-20T12:08:55.494 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T12:08:55.496 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T12:08:55.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:55 +0000 (0:00:00.094) 0:00:38.167 ******* 2020-11-20T12:08:56.001 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T12:08:56.036 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:56 +0000 (0:00:00.507) 0:00:38.674 ******* 2020-11-20T12:08:56.454 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T12:08:56.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:56 +0000 (0:00:00.452) 0:00:39.127 ******* 2020-11-20T12:08:56.712 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T12:08:56.713 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T12:08:56.751 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:56 +0000 (0:00:00.262) 0:00:39.389 ******* 2020-11-20T12:08:56.778 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:56.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:56 +0000 (0:00:00.060) 0:00:39.450 ******* 2020-11-20T12:08:57.322 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T12:08:57.325 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T12:08:57.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:57 +0000 (0:00:00.543) 0:00:39.994 ******* 2020-11-20T12:08:57.709 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T12:08:57.752 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:57 +0000 (0:00:00.395) 0:00:40.390 ******* 2020-11-20T12:08:57.758 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T12:08:57.760 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T12:08:57.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:57 +0000 (0:00:00.043) 0:00:40.434 ******* 2020-11-20T12:08:58.718 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T12:08:58.720 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T12:08:58.761 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.966) 0:00:41.400 ******* 2020-11-20T12:08:58.802 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T12:08:58.804 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.815 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.866 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.104) 0:00:41.504 ******* 2020-11-20T12:08:59.235 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi160.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:59.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:59 +0000 (0:00:00.403) 0:00:41.908 ******* 2020-11-20T12:08:59.664 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi160.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T12:08:59.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:59 +0000 (0:00:00.428) 0:00:42.336 ******* 2020-11-20T12:08:59.726 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T12:08:59.727 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:59.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:59 +0000 (0:00:00.070) 0:00:42.407 ******* 2020-11-20T12:09:00.693 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T12:09:00.695 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T12:09:00.727 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:00 +0000 (0:00:00.958) 0:00:43.366 ******* 2020-11-20T12:09:01.233 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T12:09:01.235 INFO:teuthology.task.ansible.out:fatal: [smithi160.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service nrpe: host"} ...ignoring 2020-11-20T12:09:01.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:01 +0000 (0:00:00.539) 0:00:43.905 ******* 2020-11-20T12:09:01.624 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T12:09:02.093 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.007316", "end": "2020-11-20 12:09:01.579320", "rc": 0, "start": "2020-11-20 12:09:01.572004", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} Friday 20 November 2020 12:09:01 +0000 (0:00:00.390) 0:00:44.296 ******* 2020-11-20T12:09:02.922 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T12:09:02.924 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T12:09:02.961 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:02 +0000 (0:00:01.298) 0:00:45.594 ******* 2020-11-20T12:09:04.180 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T12:09:04.217 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:01.261) 0:00:46.856 ******* 2020-11-20T12:09:06.013 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T12:09:06.015 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T12:09:06.049 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:06 +0000 (0:00:01.831) 0:00:48.687 ******* 2020-11-20T12:09:13.925 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T12:09:13.931 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.356492", "end": "2020-11-20 12:09:13.895427", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:57.538935", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T12:09:13.972 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:07.922) 0:00:56.610 ******* 2020-11-20T12:09:14.227 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.274141", "end": "2020-11-20 12:09:14.195411", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:57.921270", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T12:09:14.264 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.289) 0:00:56.899 ******* 2020-11-20T12:09:14.489 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T12:09:14.491 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T12:09:14.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.262) 0:00:57.162 ******* 2020-11-20T12:09:14.740 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T12:09:14.741 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.011930", "end": "2020-11-20 12:09:14.712898", "rc": 0, "start": "2020-11-20 12:09:14.700968", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:14.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.256) 0:00:57.418 ******* 2020-11-20T12:09:14.788 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T12:09:14.790 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T12:09:14.824 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.044) 0:00:57.463 ******* 2020-11-20T12:09:14.992 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008926", "end": "2020-11-20 12:09:14.966337", "rc": 0, "start": "2020-11-20 12:09:14.957411", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:15.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.201) 0:00:57.665 ******* 2020-11-20T12:09:15.044 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T12:09:15.046 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012486", "end": "2020-11-20 12:09:15.012402", "rc": 0, "start": "2020-11-20 12:09:14.999916", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:15.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.055) 0:00:57.720 ******* 2020-11-20T12:09:15.299 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T12:09:15.300 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.010967", "end": "2020-11-20 12:09:15.268694", "rc": 0, "start": "2020-11-20 12:09:15.257727", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:15.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.250) 0:00:57.971 ******* 2020-11-20T12:09:22.681 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T12:09:22.683 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.307778", "end": "2020-11-20 12:09:22.643440", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:09:06.335662", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T12:09:22.721 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:22 +0000 (0:00:07.386) 0:01:05.358 ******* 2020-11-20T12:09:23.668 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T12:09:23.670 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T12:09:23.724 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:23 +0000 (0:00:01.004) 0:01:06.362 ******* 2020-11-20T12:09:24.093 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.017457", "end": "2020-11-20 12:09:24.058228", "rc": 0, "start": "2020-11-20 12:09:24.040771", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:24.127 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:24 +0000 (0:00:00.402) 0:01:06.765 ******* 2020-11-20T12:09:24.470 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T12:09:24.472 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.023722", "end": "2020-11-20 12:09:24.428756", "rc": 0, "start": "2020-11-20 12:09:24.405034", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:24.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:24 +0000 (0:00:00.382) 0:01:07.148 ******* 2020-11-20T12:09:31.470 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.246714", "end": "2020-11-20 12:09:31.444253", "rc": 0, "start": "2020-11-20 12:09:15.197539", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:31.505 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:31 +0000 (0:00:06.995) 0:01:14.143 ******* 2020-11-20T12:09:31.716 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T12:09:31.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:31 +0000 (0:00:00.244) 0:01:14.388 ******* 2020-11-20T12:09:31.777 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T12:09:31.779 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:31.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:31 +0000 (0:00:00.067) 0:01:14.455 ******* 2020-11-20T12:09:31.834 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T12:09:31.835 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.292581", "end": "2020-11-20 12:09:31.811272", "rc": 0, "start": "2020-11-20 12:09:15.518691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:31.871 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:31 +0000 (0:00:00.054) 0:01:14.510 ******* 2020-11-20T12:09:31.878 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:31.880 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T12:09:31.913 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:31 +0000 (0:00:00.041) 0:01:14.551 ******* 2020-11-20T12:09:31.941 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:31.975 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:31 +0000 (0:00:00.061) 0:01:14.613 ******* 2020-11-20T12:09:32.005 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:32.007 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:32.039 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.064) 0:01:14.677 ******* 2020-11-20T12:09:32.088 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T12:09:32.090 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T12:09:32.122 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.082) 0:01:14.760 ******* 2020-11-20T12:09:32.128 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T12:09:32.130 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:09:32.171 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.048) 0:01:14.809 ******* 2020-11-20T12:09:32.178 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T12:09:32.179 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:32.216 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.045) 0:01:14.855 ******* 2020-11-20T12:09:32.256 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:32.257 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T12:09:32.290 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.073) 0:01:14.928 ******* 2020-11-20T12:09:32.317 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T12:09:32.319 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:32.351 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.060) 0:01:14.989 ******* 2020-11-20T12:09:32.377 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:32.379 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:32.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.059) 0:01:15.049 ******* 2020-11-20T12:09:32.418 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T12:09:32.424 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:09:32.455 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.045) 0:01:15.094 ******* 2020-11-20T12:09:32.485 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ ok: [smithi150.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:09:32.521 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.065) 0:01:15.159 ******* 2020-11-20T12:09:32.524 INFO:teuthology.task.ansible.out: 2020-11-20T12:09:32.753 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T12:09:32.755 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:09:32.790 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:32 +0000 (0:00:00.269) 0:01:15.428 ******* 2020-11-20T12:09:32.995 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874172.4851675-135725526822860/source", "state": "file", "uid": 0} 2020-11-20T12:09:33.028 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.238) 0:01:15.667 ******* 2020-11-20T12:09:33.057 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T12:09:33.058 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T12:09:33.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.064) 0:01:15.731 ******* 2020-11-20T12:09:33.143 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T12:09:33.144 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:33.181 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.088) 0:01:15.820 ******* 2020-11-20T12:09:33.220 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T12:09:33.222 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-11-20T12:09:33.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.074) 0:01:15.894 ******* 2020-11-20T12:09:33.295 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T12:09:33.297 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:33.329 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.073) 0:01:15.968 ******* 2020-11-20T12:09:33.338 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T12:09:33.340 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874172.8221416-158786285947262/source", "state": "file", "uid": 0} 2020-11-20T12:09:33.377 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.048) 0:01:16.016 ******* 2020-11-20T12:09:33.406 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T12:09:33.440 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.062) 0:01:16.078 ******* 2020-11-20T12:09:33.491 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T12:09:33.493 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:33.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.114) 0:01:16.192 ******* 2020-11-20T12:09:33.562 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T12:09:33.564 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:09:33.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.042) 0:01:16.235 ******* 2020-11-20T12:09:33.620 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T12:09:33.621 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-11-20T12:09:33.665 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.067) 0:01:16.303 ******* 2020-11-20T12:09:33.703 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T12:09:33.705 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:33.737 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.072) 0:01:16.375 ******* 2020-11-20T12:09:33.799 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T12:09:33.800 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T12:09:33.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.098) 0:01:16.473 ******* 2020-11-20T12:09:33.864 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T12:09:33.866 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:33.903 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.067) 0:01:16.541 ******* 2020-11-20T12:09:33.930 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T12:09:33.931 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:09:33.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.061) 0:01:16.602 ******* 2020-11-20T12:09:33.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:33 +0000 (0:00:00.031) 0:01:16.634 ******* 2020-11-20T12:09:34.171 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T12:09:34.173 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T12:09:34.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:34 +0000 (0:00:00.209) 0:01:16.843 ******* 2020-11-20T12:09:34.212 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T12:09:34.213 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T12:09:34.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:34 +0000 (0:00:00.040) 0:01:16.884 ******* 2020-11-20T12:09:34.279 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T12:09:34.281 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:34.315 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:34 +0000 (0:00:00.068) 0:01:16.953 ******* 2020-11-20T12:09:34.342 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T12:09:34.344 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:34.384 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:34 +0000 (0:00:00.069) 0:01:17.023 ******* 2020-11-20T12:09:34.612 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T12:09:34.644 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:34 +0000 (0:00:00.259) 0:01:17.282 ******* 2020-11-20T12:09:34.727 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T12:09:34.728 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T12:09:34.762 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:34 +0000 (0:00:00.117) 0:01:17.400 ******* 2020-11-20T12:09:34.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T12:09:34.804 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi134"}, "changed": false} 2020-11-20T12:09:34.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:34 +0000 (0:00:00.074) 0:01:17.475 ******* 2020-11-20T12:09:35.199 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T12:09:35.233 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:35 +0000 (0:00:00.396) 0:01:17.871 ******* 2020-11-20T12:09:35.272 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T12:09:35.274 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi150"}, "changed": false} 2020-11-20T12:09:35.307 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:35 +0000 (0:00:00.074) 0:01:17.946 ******* 2020-11-20T12:09:35.823 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi134", "ansible_hostname": "smithi134", "ansible_nodename": "smithi134"}, "changed": false, "name": "smithi134"} 2020-11-20T12:09:35.858 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:35 +0000 (0:00:00.550) 0:01:18.496 ******* 2020-11-20T12:09:35.906 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi150", "ansible_hostname": "smithi150", "ansible_nodename": "smithi150"}, "changed": false, "name": "smithi150"} 2020-11-20T12:09:35.943 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:35 +0000 (0:00:00.085) 0:01:18.581 ******* 2020-11-20T12:09:36.323 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T12:09:36.924 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} Friday 20 November 2020 12:09:36 +0000 (0:00:00.415) 0:01:18.996 ******* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} Friday 20 November 2020 12:09:36 +0000 (0:00:00.097) 0:01:19.094 ******* 2020-11-20T12:09:36.946 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T12:09:36.947 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T12:09:36.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:36 +0000 (0:00:00.529) 0:01:19.624 ******* 2020-11-20T12:09:37.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:37 +0000 (0:00:00.036) 0:01:19.660 ******* 2020-11-20T12:09:37.630 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T12:09:37.665 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:37 +0000 (0:00:00.643) 0:01:20.303 ******* 2020-11-20T12:09:37.684 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T12:09:37.719 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:37 +0000 (0:00:00.054) 0:01:20.358 ******* 2020-11-20T12:09:38.160 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T12:09:38.201 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.482) 0:01:20.840 ******* 2020-11-20T12:09:38.210 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T12:09:38.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.049) 0:01:20.889 ******* 2020-11-20T12:09:38.410 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:09:38.412 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:09:38.446 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.194) 0:01:21.083 ******* 2020-11-20T12:09:38.463 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:09:38.497 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.052) 0:01:21.136 ******* 2020-11-20T12:09:38.642 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T12:09:38.644 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T12:09:38.677 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.179) 0:01:21.315 ******* 2020-11-20T12:09:38.694 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T12:09:38.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.053) 0:01:21.368 ******* 2020-11-20T12:09:38.896 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T12:09:38.898 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T12:09:38.935 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.205) 0:01:21.573 ******* 2020-11-20T12:09:38.953 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T12:09:38.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:38 +0000 (0:00:00.058) 0:01:21.632 ******* 2020-11-20T12:09:39.403 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T12:09:39.405 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T12:09:39.438 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:39 +0000 (0:00:00.444) 0:01:22.077 ******* 2020-11-20T12:09:39.468 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T12:09:39.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:39 +0000 (0:00:00.065) 0:01:22.142 ******* 2020-11-20T12:09:39.908 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:09:39.909 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T12:09:39.947 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:39 +0000 (0:00:00.442) 0:01:22.585 ******* 2020-11-20T12:09:39.975 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T12:09:40.011 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:40 +0000 (0:00:00.063) 0:01:22.649 ******* 2020-11-20T12:09:41.050 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T12:09:41.052 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.184341", "end": "2020-11-20 12:09:40.991168", "rc": 0, "start": "2020-11-20 12:09:24.806827", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:41.089 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:01.076) 0:01:23.726 ******* 2020-11-20T12:09:41.459 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T12:09:41.493 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.406) 0:01:24.132 ******* 2020-11-20T12:09:41.523 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:41.557 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.063) 0:01:24.195 ******* 2020-11-20T12:09:41.596 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:41.598 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T12:09:41.633 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.076) 0:01:24.271 ******* 2020-11-20T12:09:41.660 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T12:09:41.661 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:41.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.060) 0:01:24.332 ******* 2020-11-20T12:09:41.721 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:41.723 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:41.756 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.062) 0:01:24.394 ******* 2020-11-20T12:09:41.775 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T12:09:41.776 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.639353", "end": "2020-11-20 12:09:41.750253", "rc": 0, "start": "2020-11-20 12:09:40.110900", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:41.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.055) 0:01:24.450 ******* 2020-11-20T12:09:41.820 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T12:09:41.822 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi160.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:09:41.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.048) 0:01:24.499 ******* 2020-11-20T12:09:41.867 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T12:09:41.868 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.659028", "end": "2020-11-20 12:09:41.836223", "rc": 0, "start": "2020-11-20 12:09:40.177195", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:41.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:41 +0000 (0:00:00.048) 0:01:24.547 ******* 2020-11-20T12:09:42.234 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T12:09:42.236 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:09:42.271 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:42 +0000 (0:00:00.361) 0:01:24.909 ******* 2020-11-20T12:09:42.310 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T12:09:42.441 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} ok: [smithi150.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-11-20T12:09:42.819 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-11-20T12:09:42.894 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2020-11-20T12:09:43.294 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T12:09:43.348 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:01.077) 0:01:25.987 ******* 2020-11-20T12:09:43.372 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T12:09:43.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.064) 0:01:26.052 ******* 2020-11-20T12:09:43.432 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T12:09:43.437 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874182.298725-245195258637388/source", "state": "file", "uid": 0} 2020-11-20T12:09:43.490 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.076) 0:01:26.128 ******* 2020-11-20T12:09:43.553 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T12:09:43.555 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T12:09:43.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.099) 0:01:26.228 ******* 2020-11-20T12:09:43.659 INFO:teuthology.task.ansible.out: 2020-11-20T12:09:43.665 INFO:teuthology.task.ansible.out:TASK [testnode : Including distro specific variables.] ************************* ok: [smithi160.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:43.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.139) 0:01:26.367 ******* 2020-11-20T12:09:43.774 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi160.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.y 2020-11-20T12:09:43.775 INFO:teuthology.task.ansible.out:ml"} 2020-11-20T12:09:43.807 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.078) 0:01:26.446 ******* 2020-11-20T12:09:43.845 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T12:09:43.845 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:43.885 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.078) 0:01:26.524 ******* 2020-11-20T12:09:43.949 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T12:09:43.951 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T12:09:43.986 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.100) 0:01:26.625 ******* 2020-11-20T12:09:44.015 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T12:09:44.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.069) 0:01:26.695 ******* 2020-11-20T12:09:44.248 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T12:09:44.250 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:09:44.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.228) 0:01:26.923 ******* 2020-11-20T12:09:44.493 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T12:09:44.499 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-11-20T12:09:44.581 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-11-20T12:09:44.625 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T12:09:44.626 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T12:09:44.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.374) 0:01:27.297 ******* 2020-11-20T12:09:44.688 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:44.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.076) 0:01:27.374 ******* 2020-11-20T12:09:44.765 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-11-20T12:09:44.767 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:44.803 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.067) 0:01:27.441 ******* 2020-11-20T12:09:44.939 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T12:09:45.027 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T12:09:45.187 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T12:09:45.189 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T12:09:45.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.418) 0:01:27.860 ******* 2020-11-20T12:09:45.407 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T12:09:45.409 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T12:09:45.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.223) 0:01:28.083 ******* 2020-11-20T12:09:45.474 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T12:09:45.477 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T12:09:45.512 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.067) 0:01:28.151 ******* 2020-11-20T12:09:45.554 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.041) 0:01:28.192 ******* 2020-11-20T12:09:45.560 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T12:09:45.562 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.041) 0:01:28.233 ******* 2020-11-20T12:09:45.607 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T12:09:45.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.066) 0:01:28.299 ******* 2020-11-20T12:09:45.671 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi134.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.673 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.045) 0:01:28.345 ******* 2020-11-20T12:09:45.714 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T12:09:45.716 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.749 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.042) 0:01:28.387 ******* 2020-11-20T12:09:45.755 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T12:09:45.757 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.790 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.040) 0:01:28.428 ******* 2020-11-20T12:09:45.797 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.799 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.042) 0:01:28.470 ******* 2020-11-20T12:09:45.838 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:09:45.840 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T12:09:45.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.041) 0:01:28.511 ******* 2020-11-20T12:09:45.880 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T12:09:45.881 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.041) 0:01:28.553 ******* 2020-11-20T12:09:45.921 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:45.955 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.040) 0:01:28.594 ******* 2020-11-20T12:09:45.962 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:09:45.964 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T12:09:45.997 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.042) 0:01:28.636 ******* 2020-11-20T12:09:46.004 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T12:09:46.006 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:46.039 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.041) 0:01:28.677 ******* 2020-11-20T12:09:46.045 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T12:09:46.047 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:46.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.043) 0:01:28.721 ******* 2020-11-20T12:09:46.111 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T12:09:46.113 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:46.150 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.067) 0:01:28.788 ******* 2020-11-20T12:09:46.240 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T12:09:46.242 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T12:09:46.242 INFO:teuthology.task.ansible.out:fatal: [smithi134.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006958", "end": "2020-11-20 12:09:46.217507", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:09:46.210549", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T12:09:46.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.126) 0:01:28.915 ******* 2020-11-20T12:09:46.310 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.034) 0:01:28.949 ******* 2020-11-20T12:09:46.317 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T12:09:46.319 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:46.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.042) 0:01:28.991 ******* 2020-11-20T12:09:46.359 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T12:09:46.361 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi160"}, "changed": false} 2020-11-20T12:09:46.399 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.045) 0:01:29.037 ******* 2020-11-20T12:09:46.406 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T12:09:46.407 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006825", "end": "2020-11-20 12:09:46.346724", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:09:46.339899", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T12:09:46.442 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.043) 0:01:29.081 ******* 2020-11-20T12:09:46.470 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T12:09:46.472 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:46.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:46 +0000 (0:00:00.061) 0:01:29.142 ******* 2020-11-20T12:09:47.289 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T12:09:47.291 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi160.front.sepia.ceph.com", "ansible_hostname": "smithi160", "ansible_nodename": "smithi160"}, "changed": true, "name": "smithi160"} 2020-11-20T12:09:47.324 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:47 +0000 (0:00:00.819) 0:01:29.962 ******* 2020-11-20T12:09:48.260 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T12:09:48.262 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T12:09:48.296 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:48 +0000 (0:00:00.972) 0:01:30.935 ******* 2020-11-20T12:09:48.702 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T12:09:48.740 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:48 +0000 (0:00:00.443) 0:01:31.378 ******* 2020-11-20T12:09:48.800 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T12:09:48.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:48 +0000 (0:00:00.096) 0:01:31.475 ******* 2020-11-20T12:09:49.222 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T12:09:49.224 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T12:09:49.287 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:49 +0000 (0:00:00.450) 0:01:31.925 ******* 2020-11-20T12:09:50.121 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T12:09:50.123 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T12:09:50.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:50 +0000 (0:00:00.869) 0:01:32.795 ******* 2020-11-20T12:09:50.701 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:09:50.703 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T12:09:50.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:50 +0000 (0:00:00.579) 0:01:33.374 ******* 2020-11-20T12:09:50.743 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T12:09:50.779 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:50 +0000 (0:00:00.042) 0:01:33.417 ******* 2020-11-20T12:09:51.101 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T12:09:51.136 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:51 +0000 (0:00:00.357) 0:01:33.774 ******* 2020-11-20T12:09:51.514 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:09:51.516 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:09:51.559 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:51 +0000 (0:00:00.423) 0:01:34.198 ******* 2020-11-20T12:09:51.903 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T12:09:51.905 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T12:09:51.937 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:51 +0000 (0:00:00.378) 0:01:34.576 ******* 2020-11-20T12:09:52.327 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T12:09:52.329 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T12:09:52.360 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:52 +0000 (0:00:00.422) 0:01:34.999 ******* 2020-11-20T12:09:53.347 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T12:09:53.601 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:53 +0000 (0:00:01.025) 0:01:36.024 ******* TASK [testnode : Install packages] ********************************************* changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} Friday 20 November 2020 12:09:53 +0000 (0:00:00.210) 0:01:36.235 ******* 2020-11-20T12:09:53.625 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T12:09:53.627 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:53.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:53 +0000 (0:00:00.062) 0:01:36.297 ******* 2020-11-20T12:09:53.880 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:09:53.882 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-11-20T12:09:53.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:53 +0000 (0:00:00.257) 0:01:36.555 ******* 2020-11-20T12:09:53.945 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:53.980 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:53 +0000 (0:00:00.063) 0:01:36.618 ******* 2020-11-20T12:09:54.360 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:09:54.361 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T12:09:54.394 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.414) 0:01:37.033 ******* 2020-11-20T12:09:54.591 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:09:54.593 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T12:09:54.626 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.231) 0:01:37.264 ******* 2020-11-20T12:09:54.654 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:09:54.657 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:54.688 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.061) 0:01:37.326 ******* 2020-11-20T12:09:54.921 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:09:54.923 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T12:09:54.957 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.267) 0:01:37.594 ******* 2020-11-20T12:09:54.995 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:54.997 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket system.slice polkit.service sysinit.target dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ipset.service shutdown.target ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": " 2020-11-20T12:09:54.998 INFO:teuthology.task.ansible.out:/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Li 2020-11-20T12:09:55.000 INFO:teuthology.task.ansible.out:mitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWh 2020-11-20T12:09:55.001 INFO:teuthology.task.ansible.out:enUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T12:09:55.034 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.078) 0:01:37.672 ******* 2020-11-20T12:09:55.068 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.034) 0:01:37.707 ******* 2020-11-20T12:09:55.340 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "polkit.service dbus.service basic.target sysinit.target system.slice dbus.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service ebtables.service shutdown.target iptables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-11-20T12:09:55.342 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", 2020-11-20T12:09:55.344 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-11-20T12:09:55.345 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T12:09:55.375 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.307) 0:01:38.014 ******* 2020-11-20T12:09:55.381 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T12:09:55.384 INFO:teuthology.task.ansible.out:fatal: [smithi150.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T12:09:55.417 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.041) 0:01:38.055 ******* 2020-11-20T12:09:55.659 INFO:teuthology.task.ansible.out:fatal: [smithi134.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T12:09:55.696 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.278) 0:01:38.334 ******* 2020-11-20T12:09:56.099 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T12:09:56.101 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T12:09:56.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.438) 0:01:38.772 ******* 2020-11-20T12:09:56.141 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T12:09:56.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.041) 0:01:38.814 ******* 2020-11-20T12:09:56.182 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T12:09:56.184 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.047) 0:01:38.862 ******* 2020-11-20T12:09:56.232 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.265 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.041) 0:01:38.903 ******* 2020-11-20T12:09:56.271 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T12:09:56.273 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.308 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.042) 0:01:38.946 ******* 2020-11-20T12:09:56.315 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.051) 0:01:38.997 ******* 2020-11-20T12:09:56.367 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T12:09:56.369 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.415 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.056) 0:01:39.054 ******* 2020-11-20T12:09:56.427 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.057) 0:01:39.112 ******* 2020-11-20T12:09:56.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T12:09:56.482 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.534 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.060) 0:01:39.172 ******* 2020-11-20T12:09:56.544 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.057) 0:01:39.230 ******* 2020-11-20T12:09:56.601 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T12:09:56.603 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.655 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.063) 0:01:39.293 ******* 2020-11-20T12:09:56.661 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.695 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.040) 0:01:39.333 ******* 2020-11-20T12:09:56.702 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.041) 0:01:39.374 ******* 2020-11-20T12:09:56.743 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.041) 0:01:39.416 ******* 2020-11-20T12:09:56.785 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T12:09:56.820 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.042) 0:01:39.459 ******* 2020-11-20T12:09:56.862 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.041) 0:01:39.500 ******* 2020-11-20T12:09:56.868 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T12:09:56.870 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.903 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.041) 0:01:39.541 ******* 2020-11-20T12:09:56.909 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.944 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.041) 0:01:39.582 ******* 2020-11-20T12:09:56.951 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T12:09:56.953 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.045) 0:01:39.628 ******* 2020-11-20T12:09:56.996 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.997 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T12:09:56.998 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.244050", "end": "2020-11-20 12:09:56.938286", "rc": 0, "start": "2020-11-20 12:09:54.694236", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:57.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.043) 0:01:39.671 ******* 2020-11-20T12:09:57.065 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.032) 0:01:39.704 ******* 2020-11-20T12:09:57.071 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T12:09:57.072 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.073 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.075 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.044) 0:01:39.748 ******* 2020-11-20T12:09:57.142 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.031) 0:01:39.780 ******* 2020-11-20T12:09:57.148 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T12:09:57.150 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.182 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.040) 0:01:39.821 ******* 2020-11-20T12:09:57.189 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.224 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.041) 0:01:39.863 ******* 2020-11-20T12:09:57.231 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T12:09:57.273 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.047) 0:01:39.910 ******* 2020-11-20T12:09:57.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.041) 0:01:39.951 ******* 2020-11-20T12:09:57.320 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T12:09:57.321 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.043) 0:01:39.995 ******* 2020-11-20T12:09:57.369 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.047) 0:01:40.043 ******* 2020-11-20T12:09:57.411 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T12:09:57.412 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.446 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.041) 0:01:40.084 ******* 2020-11-20T12:09:57.452 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.487 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.041) 0:01:40.126 ******* 2020-11-20T12:09:57.496 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.534 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.045) 0:01:40.172 ******* 2020-11-20T12:09:57.545 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.052) 0:01:40.224 ******* 2020-11-20T12:09:57.593 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.045) 0:01:40.270 ******* 2020-11-20T12:09:57.641 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.678 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.046) 0:01:40.316 ******* 2020-11-20T12:09:57.686 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T12:09:57.687 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.721 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.042) 0:01:40.359 ******* 2020-11-20T12:09:57.728 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.046) 0:01:40.406 ******* 2020-11-20T12:09:57.775 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:09:57.777 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.043) 0:01:40.449 ******* 2020-11-20T12:09:57.818 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.864 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.048) 0:01:40.498 ******* 2020-11-20T12:09:57.869 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.902 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.042) 0:01:40.540 ******* 2020-11-20T12:09:57.909 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.945 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.043) 0:01:40.584 ******* 2020-11-20T12:09:57.953 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T12:09:57.955 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:57.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.049) 0:01:40.633 ******* 2020-11-20T12:09:58.004 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.040 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.044) 0:01:40.678 ******* 2020-11-20T12:09:58.047 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** ok: [smithi160.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2020-11-20T12:09:58.049 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.094 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.053) 0:01:40.731 ******* 2020-11-20T12:09:58.105 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.145 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.051) 0:01:40.783 ******* 2020-11-20T12:09:58.156 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.044) 0:01:40.828 ******* 2020-11-20T12:09:58.197 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.048) 0:01:40.876 ******* 2020-11-20T12:09:58.247 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T12:09:58.250 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.292 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.053) 0:01:40.930 ******* 2020-11-20T12:09:58.300 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.336 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.044) 0:01:40.975 ******* 2020-11-20T12:09:58.344 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T12:09:58.346 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.043) 0:01:41.019 ******* 2020-11-20T12:09:58.387 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.042) 0:01:41.062 ******* 2020-11-20T12:09:58.430 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.466 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.042) 0:01:41.104 ******* 2020-11-20T12:09:58.473 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.042) 0:01:41.147 ******* 2020-11-20T12:09:58.515 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T12:09:58.517 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.056) 0:01:41.203 ******* 2020-11-20T12:09:58.573 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.066) 0:01:41.269 ******* 2020-11-20T12:09:58.641 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:09:58.643 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.678 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.046) 0:01:41.316 ******* 2020-11-20T12:09:58.684 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.051) 0:01:41.368 ******* 2020-11-20T12:09:58.739 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.776 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.047) 0:01:41.415 ******* 2020-11-20T12:09:58.785 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.822 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.045) 0:01:41.460 ******* 2020-11-20T12:09:58.828 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T12:09:58.830 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.041) 0:01:41.502 ******* 2020-11-20T12:09:58.871 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.045) 0:01:41.547 ******* 2020-11-20T12:09:58.918 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:58.961 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.052) 0:01:41.599 ******* 2020-11-20T12:09:58.970 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T12:09:58.972 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.006 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.045) 0:01:41.645 ******* 2020-11-20T12:09:59.014 INFO:teuthology.task.ansible.out: 2020-11-20T12:09:59.015 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:09:59.015 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.054 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.047) 0:01:41.693 ******* 2020-11-20T12:09:59.061 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.101 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.046) 0:01:41.739 ******* 2020-11-20T12:09:59.107 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T12:09:59.110 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.042) 0:01:41.781 ******* 2020-11-20T12:09:59.150 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.191 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.048) 0:01:41.830 ******* 2020-11-20T12:09:59.201 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T12:09:59.203 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.250 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.058) 0:01:41.888 ******* 2020-11-20T12:09:59.256 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.041) 0:01:41.930 ******* 2020-11-20T12:09:59.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:09:59.299 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.041) 0:01:41.971 ******* 2020-11-20T12:09:59.340 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.374 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.040) 0:01:42.012 ******* 2020-11-20T12:09:59.380 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.039) 0:01:42.052 ******* 2020-11-20T12:09:59.420 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.455 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.041) 0:01:42.093 ******* 2020-11-20T12:09:59.461 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:09:59.463 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.496 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.040) 0:01:42.134 ******* 2020-11-20T12:09:59.508 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.046) 0:01:42.180 ******* 2020-11-20T12:09:59.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:09:59.550 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.585 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.042) 0:01:42.223 ******* 2020-11-20T12:09:59.592 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.040) 0:01:42.264 ******* 2020-11-20T12:09:59.632 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:09:59.634 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.668 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.042) 0:01:42.306 ******* 2020-11-20T12:09:59.675 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.713 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.044) 0:01:42.351 ******* 2020-11-20T12:09:59.720 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T12:09:59.722 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.755 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.041) 0:01:42.393 ******* 2020-11-20T12:09:59.761 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:59.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.042) 0:01:42.435 ******* 2020-11-20T12:09:59.836 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T12:09:59.838 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2020-11-20T12:09:59.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.075) 0:01:42.511 ******* 2020-11-20T12:09:59.960 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T12:10:00.505 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} Friday 20 November 2020 12:09:59 +0000 (0:00:00.121) 0:01:42.633 ******* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} Friday 20 November 2020 12:10:00 +0000 (0:00:00.052) 0:01:42.686 ******* TASK [testnode : Create FStest ubuntu directory.] ****************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} Friday 20 November 2020 12:10:00 +0000 (0:00:00.211) 0:01:42.897 ******* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} Friday 20 November 2020 12:10:00 +0000 (0:00:00.044) 0:01:42.942 ******* TASK [testnode : Make fsstress same path as ubuntu.] *************************** [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} Friday 20 November 2020 12:10:00 +0000 (0:00:00.195) 0:01:43.138 ******* 2020-11-20T12:10:00.507 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-11-20T12:10:00.542 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.042) 0:01:43.180 ******* 2020-11-20T12:10:00.548 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T12:10:00.549 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.582 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.040) 0:01:43.221 ******* 2020-11-20T12:10:00.589 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.041) 0:01:43.262 ******* 2020-11-20T12:10:00.630 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:00.632 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.664 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.040) 0:01:43.302 ******* 2020-11-20T12:10:00.672 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.040) 0:01:43.343 ******* 2020-11-20T12:10:00.711 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.746 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.041) 0:01:43.384 ******* 2020-11-20T12:10:00.753 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.790 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.042) 0:01:43.427 ******* 2020-11-20T12:10:00.801 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T12:10:00.804 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.846 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.057) 0:01:43.484 ******* 2020-11-20T12:10:00.854 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.856 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* ok: [smithi160.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T12:10:00.893 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.046) 0:01:43.531 ******* 2020-11-20T12:10:00.926 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.033) 0:01:43.564 ******* 2020-11-20T12:10:00.933 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T12:10:00.935 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.054) 0:01:43.619 ******* 2020-11-20T12:10:01.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.044) 0:01:43.664 ******* 2020-11-20T12:10:01.032 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T12:10:01.034 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.085 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.056) 0:01:43.720 ******* 2020-11-20T12:10:01.092 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.123 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.041) 0:01:43.761 ******* 2020-11-20T12:10:01.130 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.165 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.042) 0:01:43.804 ******* 2020-11-20T12:10:01.173 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.041) 0:01:43.845 ******* 2020-11-20T12:10:01.217 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.252 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.044) 0:01:43.890 ******* 2020-11-20T12:10:01.259 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.043) 0:01:43.933 ******* 2020-11-20T12:10:01.306 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.042) 0:01:43.976 ******* 2020-11-20T12:10:01.345 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.381 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.043) 0:01:44.019 ******* 2020-11-20T12:10:01.387 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T12:10:01.389 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.422 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.041) 0:01:44.060 ******* 2020-11-20T12:10:01.428 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.039) 0:01:44.100 ******* 2020-11-20T12:10:01.468 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T12:10:01.473 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.503 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.041) 0:01:44.141 ******* 2020-11-20T12:10:01.510 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.040) 0:01:44.182 ******* 2020-11-20T12:10:01.551 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T12:10:01.552 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.046) 0:01:44.228 ******* 2020-11-20T12:10:01.598 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.043) 0:01:44.272 ******* 2020-11-20T12:10:01.641 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:01.643 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.675 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.041) 0:01:44.314 ******* 2020-11-20T12:10:01.682 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.045) 0:01:44.359 ******* 2020-11-20T12:10:01.728 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T12:10:01.729 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.764 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.043) 0:01:44.402 ******* 2020-11-20T12:10:01.773 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.050) 0:01:44.453 ******* 2020-11-20T12:10:01.825 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.048) 0:01:44.501 ******* 2020-11-20T12:10:01.871 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.042) 0:01:44.544 ******* 2020-11-20T12:10:01.922 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-11-20T12:10:01.924 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.961 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.055) 0:01:44.599 ******* 2020-11-20T12:10:01.970 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.047) 0:01:44.646 ******* TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi160.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2020-11-20T12:10:02.018 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.051 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.042) 0:01:44.689 ******* 2020-11-20T12:10:02.058 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.094 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.042) 0:01:44.732 ******* 2020-11-20T12:10:02.100 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T12:10:02.102 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.139 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.046) 0:01:44.778 ******* 2020-11-20T12:10:02.147 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.046) 0:01:44.824 ******* 2020-11-20T12:10:02.187 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:02.193 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T12:10:02.193 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.240 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.054) 0:01:44.879 ******* 2020-11-20T12:10:02.249 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.044) 0:01:44.923 ******* 2020-11-20T12:10:02.292 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.337 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.052) 0:01:44.976 ******* 2020-11-20T12:10:02.345 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.042) 0:01:45.019 ******* 2020-11-20T12:10:02.388 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.043) 0:01:45.062 ******* 2020-11-20T12:10:02.431 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.468 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.044) 0:01:45.106 ******* 2020-11-20T12:10:02.476 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.515 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.046) 0:01:45.153 ******* 2020-11-20T12:10:02.523 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.044) 0:01:45.198 ******* 2020-11-20T12:10:02.567 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:02.569 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T12:10:02.610 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.045) 0:01:45.243 ******* 2020-11-20T12:10:02.613 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T12:10:02.667 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.060) 0:01:45.304 ******* 2020-11-20T12:10:02.674 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi134.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T12:10:02.686 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.690 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.709 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.801 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.132) 0:01:45.437 ******* 2020-11-20T12:10:02.811 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi150.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi150.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:02.880 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.081) 0:01:45.518 ******* 2020-11-20T12:10:02.963 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** ok: [smithi160.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2020-11-20T12:10:03.165 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi134.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.012795", "end": "2020-11-20 12:10:03.124576", "rc": 0, "start": "2020-11-20 12:10:03.111781", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T12:10:03.212 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.328) 0:01:45.847 ******* 2020-11-20T12:10:03.217 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.010687", "end": "2020-11-20 12:10:03.163777", "rc": 0, "start": "2020-11-20 12:10:03.153090", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T12:10:03.298 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.087) 0:01:45.934 ******* 2020-11-20T12:10:03.306 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.068) 0:01:46.003 ******* 2020-11-20T12:10:03.373 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.425 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.060) 0:01:46.063 ******* 2020-11-20T12:10:03.432 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T12:10:03.435 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.051) 0:01:46.115 ******* 2020-11-20T12:10:03.485 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.050) 0:01:46.165 ******* 2020-11-20T12:10:03.540 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.589 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.059) 0:01:46.225 ******* 2020-11-20T12:10:03.596 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.045) 0:01:46.271 ******* 2020-11-20T12:10:03.641 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T12:10:03.645 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.677 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.042) 0:01:46.314 ******* 2020-11-20T12:10:03.683 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.718 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.042) 0:01:46.356 ******* 2020-11-20T12:10:03.927 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T12:10:03.929 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2020-11-20T12:10:03.970 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.252) 0:01:46.609 ******* 2020-11-20T12:10:03.998 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T12:10:04.034 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.061) 0:01:46.671 ******* 2020-11-20T12:10:04.059 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T12:10:04.061 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.061) 0:01:46.733 ******* 2020-11-20T12:10:04.143 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi160.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.153 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.197 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.098) 0:01:46.831 ******* 2020-11-20T12:10:04.221 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T12:10:04.225 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.065) 0:01:46.897 ******* 2020-11-20T12:10:04.297 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-11-20T12:10:04.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.073) 0:01:46.970 ******* 2020-11-20T12:10:04.377 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.080) 0:01:47.051 ******* 2020-11-20T12:10:04.456 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.486 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.073) 0:01:47.124 ******* 2020-11-20T12:10:04.641 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T12:10:04.643 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T12:10:04.676 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.189) 0:01:47.314 ******* 2020-11-20T12:10:04.684 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T12:10:04.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.047) 0:01:47.361 ******* 2020-11-20T12:10:04.730 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T12:10:04.732 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930573352960, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227190760, 'block_used': 12904348, 'inode_total': 61054976, 'inode_available': 60990177, 'inode_used': 64799, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227190760, "block_size": 4096, "block_total": 240095108, "block_used": 12904348, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990177, "inode_total": 61054976, "inode_used": 64799, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930573352960, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T12:10:04.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.045) 0:01:47.407 ******* 2020-11-20T12:10:04.776 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930573348864, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227190759, 'block_used': 12904349, 'inode_total': 61054976, 'inode_available': 60990177, 'inode_used': 64799, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227190759, "block_size": 4096, "block_total": 240095108, "block_used": 12904349, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990177, "inode_total": 61054976, "inode_used": 64799, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930573348864, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T12:10:04.812 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.043) 0:01:47.450 ******* 2020-11-20T12:10:04.851 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T12:10:04.852 INFO:teuthology.task.ansible.out:fatal: [smithi160.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.021128", "end": "2020-11-20 12:10:04.816002", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:10:04.794874", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T12:10:04.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.075) 0:01:47.526 ******* 2020-11-20T12:10:04.920 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-11-20T12:10:04.922 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.956 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.068) 0:01:47.595 ******* 2020-11-20T12:10:04.968 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005261", "end": "2020-11-20 12:10:04.937665", "rc": 0, "start": "2020-11-20 12:10:04.932404", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:05.008 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.051) 0:01:47.646 ******* 2020-11-20T12:10:05.026 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004937", "end": "2020-11-20 12:10:04.985138", "rc": 0, "start": "2020-11-20 12:10:04.980201", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:05.063 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.054) 0:01:47.700 ******* 2020-11-20T12:10:05.075 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi134.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930573352960, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227190760, 'block_used': 12904348, 'inode_total': 61054976, 'inode_available': 60990177, 'inode_used': 64799, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227190760, "block_size": 4096, "block_total": 240095108, "block_used": 12904348, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990177, "inode_total": 61054976, "inode_used": 64799, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930573352960, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.108 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.046) 0:01:47.746 ******* 2020-11-20T12:10:05.117 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930573348864, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227190759, 'block_used': 12904349, 'inode_total': 61054976, 'inode_available': 60990177, 'inode_used': 64799, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227190759, "block_size": 4096, "block_total": 240095108, "block_used": 12904349, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990177, "inode_total": 61054976, "inode_used": 64799, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930573348864, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.045) 0:01:47.792 ******* 2020-11-20T12:10:05.165 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T12:10:05.196 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.041) 0:01:47.834 ******* 2020-11-20T12:10:05.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.062) 0:01:47.896 ******* 2020-11-20T12:10:06.752 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWncGc0tHu5nG5Ixys2ORWr07UcPc6eU0z0'], 'uuids': ['04dbc48d-873d-4cd1-8557-a6e583827d6d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.256122", "end": "2020-11-20 12:10:06.707405", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWncGc0tHu5nG5Ixys2ORWr07UcPc6eU0z0"], "labels": [], "masters": [], "uuids": ["04dbc48d-873d-4cd1-8557-a6e583827d6d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:05.451283", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2020-11-20T12:10:06.792 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2020-11-20T12:10:06.817 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHrIy0wn11kzobuaBPwd1VHlGWluWxiauE'], 'uuids': ['bbf735d0-ab31-470b-b05f-58c10a388d37'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.387372", "end": "2020-11-20 12:10:06.776797", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHrIy0wn11kzobuaBPwd1VHlGWluWxiauE"], "labels": [], "masters": [], "uuids": ["bbf735d0-ab31-470b-b05f-58c10a388d37"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:05.389425", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:07.881 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-11-20T12:10:07.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:07 +0000 (0:00:02.658) 0:01:50.555 ******* 2020-11-20T12:10:08.017 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-fAju7I-Ny8D-4gKk-MN8B-Fz3y-y61Y-hLq6VD', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', 'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.056196", "end": "2020-11-20 12:10:07.979433", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-fAju7I-Ny8D-4gKk-MN8B-Fz3y-y61Y-hLq6VD", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:06.923237", "stderr": "", "stde 2020-11-20T12:10:08.019 INFO:teuthology.task.ansible.out:rr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:08.111 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-UGu0Kj-9MHF-j1fR-cGui-DJ8v-WG5l-4Vp8RT', 'nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN', 'nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.077666", "end": "2020-11-20 12:10:08.068685", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-UGu0Kj-9MHF-j1fR-cGui-DJ8v-WG5l-4Vp8RT", "nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN", "nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:06.991019", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T12:10:08.113 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:09.278 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnQyv7sqtsFE0jfJ502h7pc8K4Z3uLSr8P'], 'uuids': ['d7d1b782-ada3-4e01-add5-669bb055db73'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.050216", "end": "2020-11-20 12:10:09.242000", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnQyv7sqtsFE0jfJ502h7pc8K4Z3uLSr8P"], "labels": [], "masters": [], "uuids": ["d7d1b782-ada3-4e01-add5-669bb055db73"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:08.191784", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:09.418 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHFG8UrA9CqPwnL0TPQfIledUXm1yepQvo'], 'uuids': ['981929b9-cac7-491b-8f44-e4d39592696b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.075431", "end": "2020-11-20 12:10:09.385821", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHFG8UrA9CqPwnL0TPQfIledUXm1yepQvo"], "labels": [], "masters": [], "uuids": ["981929b9-cac7-491b-8f44-e4d39592696b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:08.310390", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:10.516 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnaxvFY3x3rd05nGsFfLCuWtFqtIfxuLYJ'], 'uuids': ['8400ffc9-e061-47d1-89b0-c3d5033e5c1f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.050558", "end": "2020-11-20 12:10:10.487104", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnaxvFY3x3rd05nGsFfLCuWtFqtIfxuLYJ"], "labels": [], "masters": [], "uuids": ["8400ffc9-e061-47d1-89b0-c3d5033e5c1f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:09.436546", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:10.582 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2020-11-20T12:10:10.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:10 +0000 (0:00:02.698) 0:01:53.254 ******* 2020-11-20T12:10:10.675 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:10.676 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHHk1a8VAnDIawT3kBIM9Y0i49bgFa9HZm'], 'uuids': ['6fc0ba93-882b-4953-816e-5c094984a87f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.058965", "end": "2020-11-20 12:10:10.641705", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHHk1a8VAnDIawT3kBIM9Y0i49bgFa9HZm"], "labels": [], "masters": [], "uuids": ["6fc0ba93-882b-4953-816e-5c094984a87f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:09.582740", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:11.764 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnhQnF9uAi2u13XZ5Ipmq4MAHnhIHmWgic'], 'uuids': ['c79f284b-d44b-413b-b225-f33374b4cb4f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.045832", "end": "2020-11-20 12:10:11.725995", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnhQnF9uAi2u13XZ5Ipmq4MAHnhIHmWgic"], "labels": [], "masters": [], "uuids": ["c79f284b-d44b-413b-b225-f33374b4cb4f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:10.680163", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:11.787 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME', 'wwn-0x5000c5009293e56f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTME', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293e56f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', 'wwn-0x5000c5009293e56f-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, 2020-11-20T12:10:11.789 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T12:10:11.929 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHMUif6mAyuCylp3JcluVbhdpjL7DHDtUv'], 'uuids': ['4b9ef901-d7f8-49ae-8e5c-1609fdbe6200'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.062044", "end": "2020-11-20 12:10:11.893881", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHMUif6mAyuCylp3JcluVbhdpjL7DHDtUv"], "labels": [], "masters": [], "uuids": ["4b9ef901-d7f8-49ae-8e5c-1609fdbe6200"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:10.831837", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:11.942 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV', 'wwn-0x5000c50092941659'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XNGV', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092941659', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1', 'wwn-0x5000c50092941659-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV", "wwn-0x5000c50092941659"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1", "wwn-0x5000c50092941659-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNGV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941659"}}, 2020-11-20T12:10:11.944 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T12:10:13.016 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnLDYAwRP614w73k0aBnKaoGnKNEMV4UWc'], 'uuids': ['64a950b5-3e32-4a06-b4a8-3e9f0b9f862a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.048567", "end": "2020-11-20 12:10:12.983596", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnLDYAwRP614w73k0aBnKaoGnKNEMV4UWc"], "labels": [], "masters": [], "uuids": ["64a950b5-3e32-4a06-b4a8-3e9f0b9f862a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:11.935029", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:13.056 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:02.440) 0:01:55.695 ******* 2020-11-20T12:10:13.213 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHmiJGalaIBT8xvDolQNcJ35cBrKm2Hi1v'], 'uuids': ['af7dd1b3-c80d-4b63-aad8-b080bcd56693'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.076023", "end": "2020-11-20 12:10:13.177514", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHmiJGalaIBT8xvDolQNcJ35cBrKm2Hi1v"], "labels": [], "masters": [], "uuids": ["af7dd1b3-c80d-4b63-aad8-b080bcd56693"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:12.101491", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:13.258 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:00.201) 0:01:55.897 ******* 2020-11-20T12:10:13.414 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:13.416 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWncGc0tHu5nG5Ixys2ORWr07UcPc6eU0z0'], 'uuids': ['04dbc48d-873d-4cd1-8557-a6e583827d6d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138353", "end": "2020-11-20 12:10:13.388489", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWncGc0tHu5nG5Ixys2ORWr07UcPc6eU0z0"], "labels": [], "masters": [], "uuids": ["04dbc48d-873d-4cd1-8557-a6e583827d6d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:13.250136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135808 s, 849 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135808 s, 849 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:13.618 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHrIy0wn11kzobuaBPwd1VHlGWluWxiauE'], 'uuids': ['bbf735d0-ab31-470b-b05f-58c10a388d37'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.140536", "end": "2020-11-20 12:10:13.591063", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHrIy0wn11kzobuaBPwd1VHlGWluWxiauE"], "labels": [], "masters": [], "uuids": ["bbf735d0-ab31-470b-b05f-58c10a388d37"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:13.450527", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137882 s, 837 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137882 s, 837 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:13.641 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-fAju7I-Ny8D-4gKk-MN8B-Fz3y-y61Y-hLq6VD', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', 'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037071", "end": "2020-11-20 12:10:13.605746", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-fAju7I-Ny8D-4gKk-MN8B-Fz3y-y61Y-hLq6VD", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:13.568675", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0344787 s, 3.3 GB/s", "std 2020-11-20T12:10:13.643 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0344787 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:13.837 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-UGu0Kj-9MHF-j1fR-cGui-DJ8v-WG5l-4Vp8RT', 'nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN', 'nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036524", "end": "2020-11-20 12:10:13.808760", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-UGu0Kj-9MHF-j1fR-cGui-DJ8v-WG5l-4Vp8RT", "nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN", "nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:13.772236", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0340521 s, 3.4 GB/s", "std 2020-11-20T12:10:13.839 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0340521 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:13.978 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnQyv7sqtsFE0jfJ502h7pc8K4Z3uLSr8P'], 'uuids': ['d7d1b782-ada3-4e01-add5-669bb055db73'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139332", "end": "2020-11-20 12:10:13.941660", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnQyv7sqtsFE0jfJ502h7pc8K4Z3uLSr8P"], "labels": [], "masters": [], "uuids": ["d7d1b782-ada3-4e01-add5-669bb055db73"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:13.802328", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136859 s, 843 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136859 s, 843 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:14.205 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHFG8UrA9CqPwnL0TPQfIledUXm1yepQvo'], 'uuids': ['981929b9-cac7-491b-8f44-e4d39592696b'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.140986", "end": "2020-11-20 12:10:14.151816", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHFG8UrA9CqPwnL0TPQfIledUXm1yepQvo"], "labels": [], "masters": [], "uuids": ["981929b9-cac7-491b-8f44-e4d39592696b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:14.010830", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138375 s, 834 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138375 s, 834 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:14.312 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnaxvFY3x3rd05nGsFfLCuWtFqtIfxuLYJ'], 'uuids': ['8400ffc9-e061-47d1-89b0-c3d5033e5c1f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138415", "end": "2020-11-20 12:10:14.272032", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnaxvFY3x3rd05nGsFfLCuWtFqtIfxuLYJ"], "labels": [], "masters": [], "uuids": ["8400ffc9-e061-47d1-89b0-c3d5033e5c1f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:14.133617", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135738 s, 850 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135738 s, 850 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:14.521 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHHk1a8VAnDIawT3kBIM9Y0i49bgFa9HZm'], 'uuids': ['6fc0ba93-882b-4953-816e-5c094984a87f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141135", "end": "2020-11-20 12:10:14.489820", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHHk1a8VAnDIawT3kBIM9Y0i49bgFa9HZm"], "labels": [], "masters": [], "uuids": ["6fc0ba93-882b-4953-816e-5c094984a87f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:14.348685", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138542 s, 833 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138542 s, 833 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:14.642 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnhQnF9uAi2u13XZ5Ipmq4MAHnhIHmWgic'], 'uuids': ['c79f284b-d44b-413b-b225-f33374b4cb4f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.139464", "end": "2020-11-20 12:10:14.609137", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnhQnF9uAi2u13XZ5Ipmq4MAHnhIHmWgic"], "labels": [], "masters": [], "uuids": ["c79f284b-d44b-413b-b225-f33374b4cb4f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:14.469673", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137039 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137039 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:14.657 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME', 'wwn-0x5000c5009293e56f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XTME', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009293e56f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', 'wwn-0x5000c5009293e56f-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, 2020-11-20T12:10:14.659 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.746 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: boost-random-1.66.0-6.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64"]} 2020-11-20T12:10:14.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:01.522) 0:01:57.419 ******* 2020-11-20T12:10:14.810 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T12:10:14.813 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.852 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.071) 0:01:57.491 ******* 2020-11-20T12:10:14.860 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:14.861 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHMUif6mAyuCylp3JcluVbhdpjL7DHDtUv'], 'uuids': ['4b9ef901-d7f8-49ae-8e5c-1609fdbe6200'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.141131", "end": "2020-11-20 12:10:14.816458", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHMUif6mAyuCylp3JcluVbhdpjL7DHDtUv"], "labels": [], "masters": [], "uuids": ["4b9ef901-d7f8-49ae-8e5c-1609fdbe6200"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:14.675327", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138556 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138556 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:14.863 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV', 'wwn-0x5000c50092941659'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XNGV', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50092941659', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1', 'wwn-0x5000c50092941659-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV", "wwn-0x5000c50092941659"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1", "wwn-0x5000c50092941659-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNGV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941659"}}, 2020-11-20T12:10:14.865 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.984 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnLDYAwRP614w73k0aBnKaoGnKNEMV4UWc'], 'uuids': ['64a950b5-3e32-4a06-b4a8-3e9f0b9f862a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.136000", "end": "2020-11-20 12:10:14.943387", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-SiwfzsJuPeAsfWJDBUmh4tcZlIrRhWWnLDYAwRP614w73k0aBnKaoGnKNEMV4UWc"], "labels": [], "masters": [], "uuids": ["64a950b5-3e32-4a06-b4a8-3e9f0b9f862a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:14.807387", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13343 s, 864 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13343 s, 864 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:15.028 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.175) 0:01:57.666 ******* 2020-11-20T12:10:15.194 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHmiJGalaIBT8xvDolQNcJ35cBrKm2Hi1v'], 'uuids': ['af7dd1b3-c80d-4b63-aad8-b080bcd56693'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.150025", "end": "2020-11-20 12:10:15.159921", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Zq2LsZR941geWHtAVx4hRb5jo3nR9wOHmiJGalaIBT8xvDolQNcJ35cBrKm2Hi1v"], "labels": [], "masters": [], "uuids": ["af7dd1b3-c80d-4b63-aad8-b080bcd56693"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:15.009896", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147434 s, 782 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147434 s, 782 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:15.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.208) 0:01:57.875 ******* 2020-11-20T12:10:15.296 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T12:10:15.298 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.066875", "end": "2020-11-20 12:10:15.264349", "rc": 0, "start": "2020-11-20 12:10:15.197474", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:15.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.094) 0:01:57.970 ******* 2020-11-20T12:10:15.499 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.062937", "end": "2020-11-20 12:10:15.463588", "rc": 0, "start": "2020-11-20 12:10:15.400651", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:15.533 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.201) 0:01:58.171 ******* 2020-11-20T12:10:15.573 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049671", "end": "2020-11-20 12:10:15.547268", "rc": 0, "start": "2020-11-20 12:10:15.497597", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:15.610 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.075) 0:01:58.248 ******* 2020-11-20T12:10:15.641 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T12:10:15.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.069) 0:01:58.317 ******* 2020-11-20T12:10:15.706 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T12:10:15.708 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:15.742 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.063) 0:01:58.381 ******* 2020-11-20T12:10:15.770 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.048072", "end": "2020-11-20 12:10:15.744369", "rc": 0, "start": "2020-11-20 12:10:15.696297", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:15.772 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:15.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.061) 0:01:58.443 ******* 2020-11-20T12:10:15.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.030) 0:01:58.473 ******* 2020-11-20T12:10:15.841 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T12:10:15.878 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.042) 0:01:58.516 ******* 2020-11-20T12:10:15.884 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T12:10:15.887 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:15.924 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.046) 0:01:58.563 ******* 2020-11-20T12:10:15.932 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:15.968 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:15 +0000 (0:00:00.043) 0:01:58.606 ******* 2020-11-20T12:10:15.975 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T12:10:15.977 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.009 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.041) 0:01:58.648 ******* 2020-11-20T12:10:16.016 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.054 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.044) 0:01:58.692 ******* 2020-11-20T12:10:16.082 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T12:10:16.083 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.119 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.064) 0:01:58.757 ******* 2020-11-20T12:10:16.135 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:10:16.136 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T12:10:16.170 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.051) 0:01:58.808 ******* 2020-11-20T12:10:16.177 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T12:10:16.179 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.045) 0:01:58.854 ******* 2020-11-20T12:10:16.222 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:10:16.224 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:10:16.262 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.046) 0:01:58.901 ******* 2020-11-20T12:10:16.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.034) 0:01:58.935 ******* 2020-11-20T12:10:16.314 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T12:10:16.316 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930573348864, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227190759, 'block_used': 12904349, 'inode_total': 61054976, 'inode_available': 60990177, 'inode_used': 64799, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227190759, "block_size": 4096, "block_total": 240095108, "block_used": 12904349, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990177, "inode_total": 61054976, "inode_used": 64799, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930573348864, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.356 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.058) 0:01:58.994 ******* 2020-11-20T12:10:16.384 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.419 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.062) 0:01:59.056 ******* 2020-11-20T12:10:16.425 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T12:10:16.427 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:10:16.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.043) 0:01:59.100 ******* 2020-11-20T12:10:16.469 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:16.470 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.504 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.041) 0:01:59.142 ******* 2020-11-20T12:10:16.515 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi134.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930573352960, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227190760, 'block_used': 12904348, 'inode_total': 61054976, 'inode_available': 60990177, 'inode_used': 64799, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227190760, "block_size": 4096, "block_total": 240095108, "block_used": 12904348, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60990177, "inode_total": 61054976, "inode_used": 64799, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930573352960, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.069) 0:01:59.212 ******* 2020-11-20T12:10:16.584 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:16.586 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.629 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.055) 0:01:59.268 ******* 2020-11-20T12:10:16.640 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-11-20T12:10:16.641 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.049) 0:01:59.318 ******* 2020-11-20T12:10:16.686 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T12:10:16.688 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.723 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.041) 0:01:59.360 ******* 2020-11-20T12:10:16.728 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.042) 0:01:59.402 ******* 2020-11-20T12:10:16.774 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T12:10:16.779 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** fatal: [smithi160.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service firewalld: host"} ...ignoring 2020-11-20T12:10:16.814 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.049) 0:01:59.451 ******* 2020-11-20T12:10:16.849 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.033) 0:01:59.485 ******* 2020-11-20T12:10:16.853 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:16.859 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.042) 0:01:59.528 ******* 2020-11-20T12:10:16.922 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.032) 0:01:59.560 ******* 2020-11-20T12:10:16.940 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:16.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:16 +0000 (0:00:00.060) 0:01:59.620 ******* 2020-11-20T12:10:17.059 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T12:10:17.062 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:17.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:17 +0000 (0:00:00.111) 0:01:59.732 ******* 2020-11-20T12:10:17.121 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T12:10:17.123 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:17.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:17 +0000 (0:00:00.061) 0:01:59.793 ******* 2020-11-20T12:10:17.417 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T12:10:17.419 INFO:teuthology.task.ansible.out:fatal: [smithi160.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T12:10:17.455 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:17 +0000 (0:00:00.299) 0:02:00.093 ******* 2020-11-20T12:10:17.647 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-11-20T12:10:17.649 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T12:10:17.689 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:17 +0000 (0:00:00.231) 0:02:00.325 ******* 2020-11-20T12:10:17.766 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} Friday 20 November 2020 12:10:17 +0000 (0:00:00.048) 0:02:00.373 ******* 2020-11-20T12:10:17.915 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T12:10:17.917 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T12:10:17.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:17 +0000 (0:00:00.216) 0:02:00.590 ******* 2020-11-20T12:10:17.954 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:17.993 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.077) 0:02:00.667 ******* 2020-11-20T12:10:18.057 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T12:10:18.059 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.092 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.062) 0:02:00.730 ******* 2020-11-20T12:10:18.119 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T12:10:18.121 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.165 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.074) 0:02:00.804 ******* 2020-11-20T12:10:18.195 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T12:10:18.197 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.234 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.068) 0:02:00.872 ******* 2020-11-20T12:10:18.262 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.060) 0:02:00.933 ******* 2020-11-20T12:10:18.324 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.362 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.065) 0:02:00.999 ******* 2020-11-20T12:10:18.367 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:10:18.369 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:18.391 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T12:10:18.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.067) 0:02:01.067 ******* 2020-11-20T12:10:18.455 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T12:10:18.457 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.060) 0:02:01.127 ******* 2020-11-20T12:10:18.515 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T12:10:18.518 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.060) 0:02:01.187 ******* 2020-11-20T12:10:18.588 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi160.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.621 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.072) 0:02:01.259 ******* 2020-11-20T12:10:18.651 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T12:10:18.652 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:18.686 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.063) 0:02:01.323 ******* 2020-11-20T12:10:18.723 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T12:10:18.764 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.079) 0:02:01.403 ******* 2020-11-20T12:10:18.768 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:18.795 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.065) 0:02:01.469 ******* 2020-11-20T12:10:18.857 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.891 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.060) 0:02:01.530 ******* 2020-11-20T12:10:18.918 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T12:10:18.920 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:18.953 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:00.061) 0:02:01.591 ******* 2020-11-20T12:10:18.981 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:10:18.982 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:18.984 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:10:18.985 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:19.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.078) 0:02:01.669 ******* 2020-11-20T12:10:19.066 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.128 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.096) 0:02:01.766 ******* 2020-11-20T12:10:19.156 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:19.158 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.193 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.063) 0:02:01.829 ******* 2020-11-20T12:10:19.219 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.253 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.062) 0:02:01.892 ******* 2020-11-20T12:10:19.281 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T12:10:19.283 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.315 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.061) 0:02:01.953 ******* 2020-11-20T12:10:19.345 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.379 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.064) 0:02:02.018 ******* 2020-11-20T12:10:19.386 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:10:19.388 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:19.413 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.450 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.070) 0:02:02.088 ******* 2020-11-20T12:10:19.479 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.512 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.061) 0:02:02.150 ******* 2020-11-20T12:10:19.545 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.576 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.064) 0:02:02.214 ******* 2020-11-20T12:10:19.605 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T12:10:19.607 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.652 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.075) 0:02:02.290 ******* 2020-11-20T12:10:19.691 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T12:10:19.693 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.746 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.093) 0:02:02.384 ******* 2020-11-20T12:10:19.753 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:10:19.756 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:19.760 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:19.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.064) 0:02:02.449 ******* 2020-11-20T12:10:19.852 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.041) 0:02:02.490 ******* 2020-11-20T12:10:19.860 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:10:19.862 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.899 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.047) 0:02:02.538 ******* 2020-11-20T12:10:19.938 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:19.974 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.074) 0:02:02.612 ******* 2020-11-20T12:10:20.001 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.053 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.078) 0:02:02.691 ******* 2020-11-20T12:10:20.060 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T12:10:20.062 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T12:10:20.102 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.048) 0:02:02.740 ******* 2020-11-20T12:10:20.138 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.037) 0:02:02.777 ******* 2020-11-20T12:10:20.145 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T12:10:20.149 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.192 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.053) 0:02:02.830 ******* 2020-11-20T12:10:20.221 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.076) 0:02:02.907 ******* 2020-11-20T12:10:20.298 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.336 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.067) 0:02:02.974 ******* 2020-11-20T12:10:20.351 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T12:10:20.354 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:20.365 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T12:10:20.366 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.400 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.063) 0:02:03.038 ******* 2020-11-20T12:10:20.429 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.481 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.080) 0:02:03.119 ******* 2020-11-20T12:10:20.517 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.578 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.098) 0:02:03.217 ******* 2020-11-20T12:10:20.586 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T12:10:20.590 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:20.610 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.646 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.067) 0:02:03.284 ******* 2020-11-20T12:10:20.674 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:20.676 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.708 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.062) 0:02:03.347 ******* 2020-11-20T12:10:20.726 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T12:10:20.727 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:20.753 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.796 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.082) 0:02:03.429 ******* 2020-11-20T12:10:20.818 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T12:10:20.820 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.855 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.062) 0:02:03.492 ******* 2020-11-20T12:10:20.909 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T12:10:20.911 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.948 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.094) 0:02:03.586 ******* 2020-11-20T12:10:20.956 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:20.957 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:20.995 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:20 +0000 (0:00:00.046) 0:02:03.633 ******* 2020-11-20T12:10:21.150 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T12:10:21.152 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:10:21.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:00.190) 0:02:03.824 ******* 2020-11-20T12:10:21.203 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:10:21.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:00.052) 0:02:03.876 ******* 2020-11-20T12:10:21.247 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T12:10:21.248 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T12:10:21.286 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:00.047) 0:02:03.924 ******* 2020-11-20T12:10:21.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:00.036) 0:02:03.960 ******* 2020-11-20T12:10:21.330 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T12:10:21.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:00.049) 0:02:04.010 ******* 2020-11-20T12:10:21.688 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T12:10:21.690 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:10:21.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:00.353) 0:02:04.363 ******* 2020-11-20T12:10:21.828 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T12:10:21.829 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true} 2020-11-20T12:10:21.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:00.144) 0:02:04.508 ******* 2020-11-20T12:10:22.082 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:22.084 INFO:teuthology.task.ansible.out:TASK [testnode : Make fsstress same path as ubuntu.] *************************** ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-11-20T12:10:22.120 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.247) 0:02:04.756 ******* 2020-11-20T12:10:22.145 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.180 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.062) 0:02:04.818 ******* 2020-11-20T12:10:22.208 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:22.209 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.242 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.062) 0:02:04.881 ******* 2020-11-20T12:10:22.270 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.061) 0:02:04.942 ******* 2020-11-20T12:10:22.342 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.376 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.071) 0:02:05.014 ******* 2020-11-20T12:10:22.403 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.442 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.064) 0:02:05.079 ******* 2020-11-20T12:10:22.449 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T12:10:22.451 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T12:10:22.496 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.055) 0:02:05.134 ******* 2020-11-20T12:10:22.540 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.051) 0:02:05.185 ******* 2020-11-20T12:10:22.553 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T12:10:22.556 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.590 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.041) 0:02:05.227 ******* 2020-11-20T12:10:22.596 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.052) 0:02:05.279 ******* 2020-11-20T12:10:22.647 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T12:10:22.649 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.683 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.041) 0:02:05.321 ******* 2020-11-20T12:10:22.689 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T12:10:22.691 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.045) 0:02:05.366 ******* 2020-11-20T12:10:22.735 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T12:10:22.737 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.069) 0:02:05.436 ******* 2020-11-20T12:10:22.809 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T12:10:22.811 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.062) 0:02:05.499 ******* 2020-11-20T12:10:22.868 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T12:10:22.871 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi134.front.sepia.ceph.com] => {"changed": true} 2020-11-20T12:10:22.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.054) 0:02:05.554 ******* 2020-11-20T12:10:22.948 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.032) 0:02:05.586 ******* 2020-11-20T12:10:22.954 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-11-20T12:10:22.957 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:22.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:22 +0000 (0:00:00.045) 0:02:05.632 ******* 2020-11-20T12:10:23.000 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-11-20T12:10:23.002 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.037 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.041) 0:02:05.673 ******* 2020-11-20T12:10:23.041 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T12:10:23.043 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.044) 0:02:05.718 ******* 2020-11-20T12:10:23.087 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T12:10:23.088 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.122 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.041) 0:02:05.760 ******* 2020-11-20T12:10:23.128 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T12:10:23.130 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.165 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.042) 0:02:05.803 ******* 2020-11-20T12:10:23.171 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.207 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.042) 0:02:05.845 ******* 2020-11-20T12:10:23.213 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:23.217 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.044) 0:02:05.889 ******* 2020-11-20T12:10:23.257 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T12:10:23.259 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T12:10:23.307 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.056) 0:02:05.945 ******* 2020-11-20T12:10:23.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.140) 0:02:06.086 ******* 2020-11-20T12:10:23.456 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.457 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.490 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.042) 0:02:06.129 ******* 2020-11-20T12:10:23.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.039) 0:02:06.168 ******* 2020-11-20T12:10:23.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T12:10:23.540 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.064) 0:02:06.232 ******* 2020-11-20T12:10:23.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.041) 0:02:06.273 ******* 2020-11-20T12:10:23.645 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.648 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.046) 0:02:06.320 ******* 2020-11-20T12:10:23.713 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.031) 0:02:06.352 ******* 2020-11-20T12:10:23.720 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-11-20T12:10:23.723 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.761 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.045) 0:02:06.398 ******* 2020-11-20T12:10:23.793 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.033) 0:02:06.431 ******* 2020-11-20T12:10:23.805 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.833 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.040) 0:02:06.472 ******* 2020-11-20T12:10:23.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.031) 0:02:06.503 ******* 2020-11-20T12:10:23.871 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T12:10:23.873 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.042) 0:02:06.546 ******* 2020-11-20T12:10:23.939 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.032) 0:02:06.578 ******* 2020-11-20T12:10:23.946 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-11-20T12:10:23.948 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:23.985 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:23 +0000 (0:00:00.044) 0:02:06.622 ******* 2020-11-20T12:10:24.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.035) 0:02:06.657 ******* 2020-11-20T12:10:24.025 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T12:10:24.027 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.062 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.042) 0:02:06.700 ******* 2020-11-20T12:10:24.068 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T12:10:24.070 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.045) 0:02:06.745 ******* 2020-11-20T12:10:24.113 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T12:10:24.115 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.150 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.042) 0:02:06.788 ******* 2020-11-20T12:10:24.156 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:24.163 INFO:teuthology.task.ansible.out:TASK [testnode : Stop collectl] ************************************************ 2020-11-20T12:10:24.167 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.060) 0:02:06.849 ******* 2020-11-20T12:10:24.221 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.264 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.053) 0:02:06.903 ******* 2020-11-20T12:10:24.272 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T12:10:24.273 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.322 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.058) 0:02:06.961 ******* 2020-11-20T12:10:24.330 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T12:10:24.335 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.375 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.051) 0:02:07.013 ******* 2020-11-20T12:10:24.381 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T12:10:24.383 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.423 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.047) 0:02:07.061 ******* 2020-11-20T12:10:24.451 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.065) 0:02:07.126 ******* 2020-11-20T12:10:24.494 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T12:10:24.497 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T12:10:24.537 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.043) 0:02:07.170 ******* 2020-11-20T12:10:24.539 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:24.540 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T12:10:24.629 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.088) 0:02:07.259 ******* 2020-11-20T12:10:24.685 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi160.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.699 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T12:10:24.713 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.716 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.717 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.736 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.737 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:24.777 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.155) 0:02:07.414 ******* 2020-11-20T12:10:24.870 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:03:32 UTC", "ActiveEnterTimestampMonotonic": "15874199", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount ntpdate.service systemd-tmpfiles-setup.service sntp.service systemd-journald.socket -.mount basic.target system.slice sysinit.target ntpd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:03:31 UTC", "AssertTimestampMonotonic": "14785416", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:03:31 UTC", "ConditionTimestampMonotonic": "14785375", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.servic 2020-11-20T12:10:24.874 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2448", "ExecMainStartTimestamp": "Fri 2020-11-20 12:03:32 UTC", "ExecMainStartTimestampMonotonic": "15843570", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:03:31 UTC", "InactiveExitTimestampMonotonic": "14810048", "InvocationID": "b0e727d4a4ab4aa9ac3ecf5b2cd2d3f7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infini 2020-11-20T12:10:24.876 INFO:teuthology.task.ansible.out:ty", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2448", "MemoryAccounting": "yes", "MemoryCurrent": "2846720", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits" 2020-11-20T12:10:24.877 INFO:teuthology.task.ansible.out:: "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:03:32 UTC", "StateChangeTimestampMonotonic": "15874199", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:03:32 UTC", "WatchdogTimestampMonotonic": "15843585", "WatchdogUSec": "0"}} 2020-11-20T12:10:24.909 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.131) 0:02:07.546 ******* 2020-11-20T12:10:24.930 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T12:10:24.974 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:00.067) 0:02:07.613 ******* 2020-11-20T12:10:24.983 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:24.985 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T12:10:24.986 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T12:10:24.986 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.011138", "end": "2020-11-20 12:10:24.958002", "rc": 0, "start": "2020-11-20 12:10:24.946864", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T12:10:25.035 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.060) 0:02:07.674 ******* 2020-11-20T12:10:25.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.037) 0:02:07.711 ******* 2020-11-20T12:10:25.079 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:25.081 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T12:10:25.116 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.042) 0:02:07.754 ******* 2020-11-20T12:10:25.125 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.166 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.049) 0:02:07.804 ******* 2020-11-20T12:10:25.173 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T12:10:25.175 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.215 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.049) 0:02:07.853 ******* 2020-11-20T12:10:25.224 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.041) 0:02:07.895 ******* 2020-11-20T12:10:25.263 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.301 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.044) 0:02:07.939 ******* 2020-11-20T12:10:25.307 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T12:10:25.308 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.343 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.042) 0:02:07.981 ******* 2020-11-20T12:10:25.350 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T12:10:25.351 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:03:20 UTC", "ActiveEnterTimestampMonotonic": "16029219", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service ntpd.service basic.target tmp.mount sysinit.target system.slice sntp.service -.mount systemd-journald.socket ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:03:19 UTC", "AssertTimestampMonotonic": "14859461", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:03:19 UTC", "ConditionTimestampMonotonic": "14859433", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-11-20T12:10:25.353 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2418", "ExecMainStartTimestamp": "Fri 2020-11-20 12:03:20 UTC", "ExecMainStartTimestampMonotonic": "15985871", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:03:19 UTC", "InactiveExitTimestampMonotonic": "14890805", "InvocationID": "4ce92c57690d40f2b1a9cc5011764309", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-11-20T12:10:25.354 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127426", "LimitNPROCSoft": "127426", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127426", "LimitSIGPENDINGSoft": "127426", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2418", "MemoryAccounting": "yes", "MemoryCurrent": "2752512", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-11-20T12:10:25.356 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:03:20 UTC", "StateChangeTimestampMonotonic": "16029219", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:03:20 UTC", "WatchdogTimestampMonotonic": "15985885", "WatchdogUSec": "0"}} TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.042) 0:02:08.024 ******* 2020-11-20T12:10:25.417 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.031) 0:02:08.056 ******* 2020-11-20T12:10:25.424 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T12:10:25.429 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T12:10:25.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.046) 0:02:08.102 ******* 2020-11-20T12:10:25.499 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.034) 0:02:08.137 ******* 2020-11-20T12:10:25.506 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:25.508 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T12:10:25.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.045) 0:02:08.183 ******* 2020-11-20T12:10:25.574 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T12:10:25.576 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.611 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.064) 0:02:08.247 ******* 2020-11-20T12:10:25.637 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T12:10:25.647 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T12:10:25.672 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.062) 0:02:08.310 ******* 2020-11-20T12:10:25.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.032) 0:02:08.342 ******* 2020-11-20T12:10:25.710 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T12:10:25.712 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:25.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.070) 0:02:08.413 ******* 2020-11-20T12:10:25.973 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T12:10:25.975 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T12:10:26.008 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:26 +0000 (0:00:00.232) 0:02:08.646 ******* 2020-11-20T12:10:26.203 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T12:10:26.205 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T12:10:26.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:26 +0000 (0:00:00.230) 0:02:08.876 ******* 2020-11-20T12:10:26.483 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T12:10:26.528 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:26 +0000 (0:00:00.290) 0:02:09.167 ******* 2020-11-20T12:10:26.749 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T12:10:26.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:26 +0000 (0:00:00.256) 0:02:09.424 ******* 2020-11-20T12:10:26.825 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T12:10:26.827 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 927554727936, 'block_size': 4096, 'block_total': 240095108, 'block_available': 226453791, 'block_used': 13641317, 'inode_total': 61054976, 'inode_available': 60988135, 'inode_used': 66841, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226453791, "block_size": 4096, "block_total": 240095108, "block_used": 13641317, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60988135, "inode_total": 61054976, "inode_used": 66841, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 927554727936, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}} 2020-11-20T12:10:26.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:26 +0000 (0:00:00.074) 0:02:09.498 ******* 2020-11-20T12:10:27.208 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T12:10:27.211 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.021219", "end": "2020-11-20 12:10:27.170106", "rc": 0, "start": "2020-11-20 12:10:27.148887", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:27.243 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.383) 0:02:09.881 ******* 2020-11-20T12:10:27.281 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T12:10:27.282 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 927554727936, 'block_size': 4096, 'block_total': 240095108, 'block_available': 226453791, 'block_used': 13641317, 'inode_total': 61054976, 'inode_available': 60988135, 'inode_used': 66841, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226453791, "block_size": 4096, "block_total": 240095108, "block_used": 13641317, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60988135, "inode_total": 61054976, "inode_used": 66841, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 927554727936, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:27.317 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.073) 0:02:09.955 ******* 2020-11-20T12:10:27.346 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T12:10:27.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.062) 0:02:10.018 ******* 2020-11-20T12:10:27.449 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T12:10:27.451 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:27.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.105) 0:02:10.123 ******* 2020-11-20T12:10:27.513 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T12:10:27.515 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:27.549 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.063) 0:02:10.187 ******* 2020-11-20T12:10:27.576 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T12:10:27.578 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} TASK [testnode : Set interface] ************************************************ ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T12:10:27.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.064) 0:02:10.251 ******* 2020-11-20T12:10:27.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.034) 0:02:10.285 ******* 2020-11-20T12:10:27.655 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T12:10:27.657 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:27.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.044) 0:02:10.330 ******* 2020-11-20T12:10:27.723 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T12:10:27.724 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T12:10:27.756 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.064) 0:02:10.394 ******* 2020-11-20T12:10:27.838 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T12:10:27.840 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T12:10:27.873 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.117) 0:02:10.511 ******* 2020-11-20T12:10:27.901 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T12:10:27.905 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:27.936 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.062) 0:02:10.574 ******* 2020-11-20T12:10:27.952 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T12:10:27.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.054) 0:02:10.628 ******* 2020-11-20T12:10:27.997 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T12:10:27.998 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T12:10:28.032 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.041) 0:02:10.670 ******* 2020-11-20T12:10:28.038 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T12:10:28.040 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.074 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.042) 0:02:10.712 ******* 2020-11-20T12:10:28.081 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T12:10:28.083 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.117 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.041) 0:02:10.754 ******* 2020-11-20T12:10:28.123 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T12:10:28.125 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T12:10:28.160 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.042) 0:02:10.797 ******* 2020-11-20T12:10:28.188 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T12:10:28.190 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.244 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.084) 0:02:10.881 ******* 2020-11-20T12:10:28.327 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T12:10:28.328 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T12:10:28.374 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.131) 0:02:11.012 ******* 2020-11-20T12:10:28.471 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T12:10:28.473 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:28.507 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.133) 0:02:11.146 ******* 2020-11-20T12:10:28.577 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T12:10:28.579 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T12:10:28.617 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.109) 0:02:11.255 ******* 2020-11-20T12:10:28.657 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T12:10:28.661 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.691 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.074) 0:02:11.330 ******* 2020-11-20T12:10:28.721 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T12:10:28.724 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T12:10:28.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.065) 0:02:11.395 ******* 2020-11-20T12:10:28.764 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T12:10:28.766 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.767 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.045) 0:02:11.440 ******* 2020-11-20T12:10:28.810 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-11-20T12:10:28.811 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.047) 0:02:11.488 ******* 2020-11-20T12:10:28.859 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T12:10:28.861 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.862 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.873 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.910 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.060) 0:02:11.548 ******* 2020-11-20T12:10:28.916 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T12:10:28.918 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.918 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:28.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.042) 0:02:11.591 ******* 2020-11-20T12:10:28.954 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:28.960 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.000 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:28 +0000 (0:00:00.048) 0:02:11.639 ******* 2020-11-20T12:10:29.010 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T12:10:29.012 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.023 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.027 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.058 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.057) 0:02:11.697 ******* 2020-11-20T12:10:29.090 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.031) 0:02:11.729 ******* 2020-11-20T12:10:29.097 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:29.100 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptPcMZxuhcCe3FhI1xuLNju1Ic3ReIPN7Y'], 'uuids': ['49c53527-73f5-448b-b632-27db4c2d90a0'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.292575", "end": "2020-11-20 12:10:28.987274", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptPcMZxuhcCe3FhI1xuLNju1Ic3ReIPN7Y"], "labels": [], "masters": [], "uuids": ["49c53527-73f5-448b-b632-27db4c2d90a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:27.694699", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : set_fact] ***************** 2020-11-20T12:10:29.102 INFO:teuthology.task.ansible.out:************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.136 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.045) 0:02:11.774 ******* 2020-11-20T12:10:29.142 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T12:10:29.144 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.182 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.043) 0:02:11.818 ******* 2020-11-20T12:10:29.188 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T12:10:29.189 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.041) 0:02:11.860 ******* 2020-11-20T12:10:29.228 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.264 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.041) 0:02:11.902 ******* 2020-11-20T12:10:29.271 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.307 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.043) 0:02:11.945 ******* 2020-11-20T12:10:29.314 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.357 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.045) 0:02:11.990 ******* 2020-11-20T12:10:29.361 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.396 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.044) 0:02:12.034 ******* 2020-11-20T12:10:29.403 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T12:10:29.406 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.050) 0:02:12.085 ******* 2020-11-20T12:10:29.456 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.498 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.050) 0:02:12.136 ******* 2020-11-20T12:10:29.505 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.050) 0:02:12.186 ******* 2020-11-20T12:10:29.556 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.046) 0:02:12.233 ******* 2020-11-20T12:10:29.602 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T12:10:29.602 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.640 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.041) 0:02:12.275 ******* 2020-11-20T12:10:29.646 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.684 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.046) 0:02:12.322 ******* 2020-11-20T12:10:29.725 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:29.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:29 +0000 (0:00:00.073) 0:02:12.395 ******* 2020-11-20T12:10:29.864 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T12:10:29.866 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004678", "end": "2020-11-20 12:10:29.828185", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 12:10:29.823507", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.014 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004596", "end": "2020-11-20 12:10:29.957809", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 12:10:29.953213", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.059 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003000", "end": "2020-11-20 12:10:30.025036", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 12:10:30.022036", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.209 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002887", "end": "2020-11-20 12:10:30.171808", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 12:10:30.168921", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.231 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002593", "end": "2020-11-20 12:10:30.202285", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:10:30.199692", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.398 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002788", "end": "2020-11-20 12:10:30.363809", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:10:30.361021", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.441 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YVyuJT-TPjE-mYrI-L2PH-02mb-RBpc-dWBYZx', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JY400BGN', 'nvme-nvme.8086-435646543632333330304a5934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.073892", "end": "2020-11-20 12:10:30.392788", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-YVyuJT-TPjE-mYrI-L2PH-02mb-RBpc-dWBYZx", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JY400BGN", "nvme-nvme.8086-435646543632333330304a5934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:29.318896", "stderr": "", "stde 2020-11-20T12:10:30.443 INFO:teuthology.task.ansible.out:rr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:30.452 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi150.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.036744", "end": "2020-11-20 12:10:30.420728", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 12:10:30.383984", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.488 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:30 +0000 (0:00:00.731) 0:02:13.126 ******* 2020-11-20T12:10:30.515 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T12:10:30.548 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:30 +0000 (0:00:00.059) 0:02:13.186 ******* 2020-11-20T12:10:30.608 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T12:10:30.611 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024109", "end": "2020-11-20 12:10:30.576546", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 12:10:30.552437", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:30.653 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:30 +0000 (0:00:00.103) 0:02:13.290 ******* 2020-11-20T12:10:30.680 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T12:10:30.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:30 +0000 (0:00:00.062) 0:02:13.353 ******* 2020-11-20T12:10:30.753 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:10:30.918 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:10:31.841 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptz3QbMpTeW1lIqDLiGeXvNS8PLzB6RgTc'], 'uuids': ['508582a0-df53-496d-b6b5-97fffd0062cf'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.067385", "end": "2020-11-20 12:10:31.792231", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptz3QbMpTeW1lIqDLiGeXvNS8PLzB6RgTc"], "labels": [], "masters": [], "uuids": ["508582a0-df53-496d-b6b5-97fffd0062cf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:30.724846", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2020-11-20T12:10:31.843 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} 2020-11-20T12:10:33.226 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptr9TXzFa0fUaUDawrVIaWF21eI5YnMTwW'], 'uuids': ['6c4e2d1e-dd2e-4452-8404-5ddb878f299a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.057829", "end": "2020-11-20 12:10:33.176759", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptr9TXzFa0fUaUDawrVIaWF21eI5YnMTwW"], "labels": [], "masters": [], "uuids": ["6c4e2d1e-dd2e-4452-8404-5ddb878f299a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:32.118930", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:34.611 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptXjcpjGOF1W04OsVIliXhLgp9TBnPVae2'], 'uuids': ['716598ca-b488-4550-a061-893291d8d56e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.062311", "end": "2020-11-20 12:10:34.566757", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptXjcpjGOF1W04OsVIliXhLgp9TBnPVae2"], "labels": [], "masters": [], "uuids": ["716598ca-b488-4550-a061-893291d8d56e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:33.504446", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:34.622 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFZB', 'wwn-0x5000c5009292466b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFZB', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009292466b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFZB-part1', 'wwn-0x5000c5009292466b-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFZB", "wwn-0x5000c5009292466b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFZB-part1", "wwn-0x5000c5009292466b-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFZB", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292466b"}}, 2020-11-20T12:10:34.624 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.009 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptiKfX1S1k7fOzF4VE3N6KAXCfPHuTRV7y'], 'uuids': ['e1f1ab43-ff73-444a-a26d-d2fe68de5311'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.060399", "end": "2020-11-20 12:10:35.960447", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptiKfX1S1k7fOzF4VE3N6KAXCfPHuTRV7y"], "labels": [], "masters": [], "uuids": ["e1f1ab43-ff73-444a-a26d-d2fe68de5311"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:34.900048", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:36.058 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:05.343) 0:02:18.696 ******* 2020-11-20T12:10:38.220 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:38.222 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptPcMZxuhcCe3FhI1xuLNju1Ic3ReIPN7Y'], 'uuids': ['49c53527-73f5-448b-b632-27db4c2d90a0'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:01.790421", "end": "2020-11-20 12:10:38.167468", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptPcMZxuhcCe3FhI1xuLNju1Ic3ReIPN7Y"], "labels": [], "masters": [], "uuids": ["49c53527-73f5-448b-b632-27db4c2d90a0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:36.377047", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.7798 s, 64.8 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.7798 s, 64.8 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:38.964 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-YVyuJT-TPjE-mYrI-L2PH-02mb-RBpc-dWBYZx', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JY400BGN', 'nvme-nvme.8086-435646543632333330304a5934303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.429125", "end": "2020-11-20 12:10:38.920102", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-YVyuJT-TPjE-mYrI-L2PH-02mb-RBpc-dWBYZx", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JY400BGN", "nvme-nvme.8086-435646543632333330304a5934303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:38.490977", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.417288 s, 276 MB/s", "stde 2020-11-20T12:10:38.967 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.417288 s, 276 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:41.370 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptz3QbMpTeW1lIqDLiGeXvNS8PLzB6RgTc'], 'uuids': ['508582a0-df53-496d-b6b5-97fffd0062cf'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:02.085968", "end": "2020-11-20 12:10:41.307779", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptz3QbMpTeW1lIqDLiGeXvNS8PLzB6RgTc"], "labels": [], "masters": [], "uuids": ["508582a0-df53-496d-b6b5-97fffd0062cf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:39.221811", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 2.07553 s, 55.6 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 2.07553 s, 55.6 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:43.509 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptr9TXzFa0fUaUDawrVIaWF21eI5YnMTwW'], 'uuids': ['6c4e2d1e-dd2e-4452-8404-5ddb878f299a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:01.811372", "end": "2020-11-20 12:10:43.463214", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptr9TXzFa0fUaUDawrVIaWF21eI5YnMTwW"], "labels": [], "masters": [], "uuids": ["6c4e2d1e-dd2e-4452-8404-5ddb878f299a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:41.651842", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.79935 s, 64.1 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.79935 s, 64.1 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:45.624 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptXjcpjGOF1W04OsVIliXhLgp9TBnPVae2'], 'uuids': ['716598ca-b488-4550-a061-893291d8d56e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:01.795003", "end": "2020-11-20 12:10:45.576372", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptXjcpjGOF1W04OsVIliXhLgp9TBnPVae2"], "labels": [], "masters": [], "uuids": ["716598ca-b488-4550-a061-893291d8d56e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:43.781369", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.78488 s, 64.6 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.78488 s, 64.6 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:45.626 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFZB', 'wwn-0x5000c5009292466b'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XFZB', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c5009292466b', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFZB-part1', 'wwn-0x5000c5009292466b-part1'], 'uuids': ['9bdf28e7-5b1a-4776-884c-191bd8ad39f5'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFZB", "wwn-0x5000c5009292466b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFZB-part1", "wwn-0x5000c5009292466b-part1"], "labels": [], "masters": [], "uuids": ["9bdf28e7-5b1a-4776-884c-191bd8ad39f5"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFZB", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009292466b"}}, 2020-11-20T12:10:45.628 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2020-11-20T12:10:47.741 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptiKfX1S1k7fOzF4VE3N6KAXCfPHuTRV7y'], 'uuids': ['e1f1ab43-ff73-444a-a26d-d2fe68de5311'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:01.790329", "end": "2020-11-20 12:10:47.699307", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Ax7pl3QegeHBO1UsLzlemLHtBWkFpfptiKfX1S1k7fOzF4VE3N6KAXCfPHuTRV7y"], "labels": [], "masters": [], "uuids": ["e1f1ab43-ff73-444a-a26d-d2fe68de5311"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:45.908978", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 1.77882 s, 64.8 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 1.77882 s, 64.8 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:47.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:47 +0000 (0:00:11.722) 0:02:30.419 ******* 2020-11-20T12:10:48.195 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi160.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.093693", "end": "2020-11-20 12:10:48.158100", "rc": 0, "start": "2020-11-20 12:10:48.064407", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:48.230 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:48 +0000 (0:00:00.449) 0:02:30.868 ******* 2020-11-20T12:10:48.626 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T12:10:48.628 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.077137", "end": "2020-11-20 12:10:48.592548", "rc": 0, "start": "2020-11-20 12:10:48.515411", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:48.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:48 +0000 (0:00:00.430) 0:02:31.299 ******* 2020-11-20T12:10:48.688 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T12:10:48.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:48 +0000 (0:00:00.064) 0:02:31.363 ******* 2020-11-20T12:10:48.752 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T12:10:48.753 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:48.791 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:48 +0000 (0:00:00.063) 0:02:31.427 ******* 2020-11-20T12:10:48.815 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T12:10:48.817 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:48.851 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:48 +0000 (0:00:00.062) 0:02:31.489 ******* 2020-11-20T12:10:48.878 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:48.919 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:48 +0000 (0:00:00.068) 0:02:31.557 ******* 2020-11-20T12:10:48.946 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:48.982 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:48 +0000 (0:00:00.062) 0:02:31.620 ******* 2020-11-20T12:10:49.325 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T12:10:49.327 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:10:49.362 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.379) 0:02:32.000 ******* 2020-11-20T12:10:49.400 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T12:10:49.402 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 927554727936, 'block_size': 4096, 'block_total': 240095108, 'block_available': 226453791, 'block_used': 13641317, 'inode_total': 61054976, 'inode_available': 60988135, 'inode_used': 66841, 'uuid': '9bdf28e7-5b1a-4776-884c-191bd8ad39f5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226453791, "block_size": 4096, "block_total": 240095108, "block_used": 13641317, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60988135, "inode_total": 61054976, "inode_used": 66841, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 927554727936, "size_total": 983429562368, "uuid": "9bdf28e7-5b1a-4776-884c-191bd8ad39f5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.436 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.074) 0:02:32.075 ******* 2020-11-20T12:10:49.464 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.498 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.061) 0:02:32.136 ******* 2020-11-20T12:10:49.549 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:49.551 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.588 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.090) 0:02:32.226 ******* 2020-11-20T12:10:49.618 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:49.620 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.072) 0:02:32.299 ******* 2020-11-20T12:10:49.699 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.734 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.073) 0:02:32.372 ******* 2020-11-20T12:10:49.773 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.806 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.072) 0:02:32.444 ******* 2020-11-20T12:10:49.849 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T12:10:49.852 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.900 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.093) 0:02:32.538 ******* 2020-11-20T12:10:50.644 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T12:10:50.679 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.778) 0:02:33.317 ******* 2020-11-20T12:10:51.325 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:51.989 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:52.608 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:53.196 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:53.765 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:53.801 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:53 +0000 (0:00:03.122) 0:02:36.439 ******* 2020-11-20T12:10:54.149 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T12:10:54.151 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T12:10:54.184 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:54 +0000 (0:00:00.381) 0:02:36.821 ******* 2020-11-20T12:10:54.541 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:54.890 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:55.205 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:55.564 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:55.575 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:55.632 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:55 +0000 (0:00:01.449) 0:02:38.271 ******* 2020-11-20T12:10:55.971 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T12:10:55.973 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:10:56.014 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.381) 0:02:38.652 ******* 2020-11-20T12:10:56.051 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-11-20T12:10:56.053 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-11-20T12:10:56.086 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.072) 0:02:38.725 ******* 2020-11-20T12:10:56.578 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T12:10:56.580 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"changed": true} 2020-11-20T12:10:56.614 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.527) 0:02:39.252 ******* 2020-11-20T12:10:57.786 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T12:10:58.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:01.208) 0:02:40.460 ******* TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:57 +0000 (0:00:00.061) 0:02:40.522 ******* TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:57 +0000 (0:00:00.061) 0:02:40.584 ******* TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:00.061) 0:02:40.645 ******* TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:00.061) 0:02:40.706 ******* TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:00.062) 0:02:40.769 ******* TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:00.060) 0:02:40.830 ******* TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:0 2020-11-20T12:10:58.550 INFO:teuthology.task.ansible.out:0.062) 0:02:40.893 ******* TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:00.077) 0:02:40.971 ******* TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:00.073) 0:02:41.044 ******* TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:58 +0000 (0:00:00.080) 0:02:41.125 ******* TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.079) 0:02:41.204 ******* 2020-11-20T12:10:59.495 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T12:10:59.498 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T12:10:59.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:59 +0000 (0:00:00.965) 0:02:42.170 ******* 2020-11-20T12:11:00.042 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T12:11:00.044 INFO:teuthology.task.ansible.out:fatal: [smithi160.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service chronyd: host"} ...ignoring 2020-11-20T12:11:00.086 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.554) 0:02:42.724 ******* 2020-11-20T12:11:00.113 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T12:11:00.147 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.060) 0:02:42.785 ******* 2020-11-20T12:11:00.184 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:11:00.186 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T12:11:00.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.071) 0:02:42.856 ******* 2020-11-20T12:11:00.245 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T12:11:00.247 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.280 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.061) 0:02:42.918 ******* 2020-11-20T12:11:00.306 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T12:11:00.308 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.340 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.060) 0:02:42.979 ******* 2020-11-20T12:11:00.369 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T12:11:00.370 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.061) 0:02:43.041 ******* 2020-11-20T12:11:00.754 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T12:11:00.755 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T12:11:00.790 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.387) 0:02:43.428 ******* 2020-11-20T12:11:01.735 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T12:11:01.737 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T12:11:01.769 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:01 +0000 (0:00:00.979) 0:02:44.408 ******* 2020-11-20T12:11:03.361 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T12:11:04.127 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:01.634) 0:02:46.042 ******* TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:03 +0000 (0:00:00.068) 0:02:46.111 ******* TASK [testnode : Set interface] ************************************************ ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} Friday 20 November 2020 12:11:03 +0000 (0:00:00.073) 0:02:46.185 ******* TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi160.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} Friday 20 November 2020 12:11:03 +0000 (0:00:00.377) 0:02:46.562 ******* TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:04 +0000 (0:00:00.084) 0:02:46.646 ******* TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi160.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} Friday 20 November 2020 12:11:04 +0000 (0:00:00.062) 0:02:46.709 ******* TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:04.147 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.076) 0:02:46.785 ******* 2020-11-20T12:11:04.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T12:11:04.509 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T12:11:04.544 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.394) 0:02:47.180 ******* 2020-11-20T12:11:04.888 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-11-20T12:11:04.890 INFO:teuthology.task.ansible.out:changed: [smithi160.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T12:11:04.940 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.398) 0:02:47.579 ******* 2020-11-20T12:11:04.969 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.064) 0:02:47.644 ******* 2020-11-20T12:11:05.044 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T12:11:05.046 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.056 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.067 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.104 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.097) 0:02:47.741 ******* 2020-11-20T12:11:05.142 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T12:11:05.145 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.154 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi160.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.166 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.168 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.100) 0:02:47.841 ******* 2020-11-20T12:11:05.230 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.063) 0:02:47.905 ******* 2020-11-20T12:11:05.294 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-11-20T12:11:05.295 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.061) 0:02:47.966 ******* 2020-11-20T12:11:05.354 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T12:11:05.356 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.390 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.062) 0:02:48.029 ******* 2020-11-20T12:11:05.417 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T12:11:05.419 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.451 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.060) 0:02:48.090 ******* 2020-11-20T12:11:05.478 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-11-20T12:11:05.480 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.068) 0:02:48.158 ******* 2020-11-20T12:11:05.547 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T12:11:05.549 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.586 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.066) 0:02:48.225 ******* 2020-11-20T12:11:05.613 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T12:11:05.615 INFO:teuthology.task.ansible.out:skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.650 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.064) 0:02:48.289 ******* 2020-11-20T12:11:05.678 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi160.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.715 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.064) 0:02:48.353 ******* 2020-11-20T12:11:06.090 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T12:11:06.092 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.017724", "end": "2020-11-20 12:11:06.038834", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 12:11:06.021110", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:06.418 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.012932", "end": "2020-11-20 12:11:06.371794", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 12:11:06.358862", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:06.780 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.011505", "end": "2020-11-20 12:11:06.726847", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:11:06.715342", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:07.112 INFO:teuthology.task.ansible.out:ok: [smithi160.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.028270", "end": "2020-11-20 12:11:07.070674", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 12:11:07.042404", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:07.148 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:01.433) 0:02:49.787 ******* 2020-11-20T12:11:07.175 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T12:11:07.211 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.062) 0:02:49.850 ******* 2020-11-20T12:11:07.556 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi160.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:11:07.651 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-20T12:11:07.653 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-11-20T12:11:07.656 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-11-20T12:11:07.660 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi134.front.sepia.ceph.com : ok=115 changed=33 unreachable=0 failed=0 skipped=181 rescued=0 ignored=3 smithi150.front.sepia.ceph.com : ok=115 changed=33 unreachable=0 failed=0 skipped=181 rescued=0 ignored=3 smithi160.front.sepia.ceph.com : ok=115 changed=34 unreachable=0 failed=0 skipped=181 rescued=0 ignored=6 Friday 20 November 2020 12:11:07 +0000 (0:00:00.448) 0:02:50.298 ******* =============================================================================== testnode : Blow away lingering OSD data and FSIDs ---------------------- 11.72s common : nrpe - Remove SELinux policy package --------------------------- 7.92s common : nrpe - Load SELinux policy package ----------------------------- 7.00s common : Install Kerberos Packages (RedHat) ----------------------------- 3.35s testnode : Create logical volume(s) ------------------------------------- 3.12s testnode : Ensure ceph dependency packages are not present. ------------- 2.70s Gathering Facts --------------------------------------------------------- 2.57s testnode : Install packages --------------------------------------------- 2.44s common : Make sure smartmontools is installed --------------------------- 2.18s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.83s testnode : Install packages via pip ------------------------------------- 1.63s testnode : Write /scratch_devs ------------------------------------------ 1.45s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.43s common : nrpe - Install SELinux dependencies ---------------------------- 1.30s common : nrpe - Ensure SELinux policy is up to date --------------------- 1.26s testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph -- 2020-11-20T12:11:07.665 INFO:teuthology.task.ansible.out:------------------- 1.21s common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 1.08s testnode : Configure /etc/sudoers. -------------------------------------- 1.03s common : nrpe - Copy SELinux type enforcement file ---------------------- 1.00s testnode : Create pip.conf and configure it to use our mirror ----------- 0.98s 2020-11-20T12:11:08.044 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi160.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2020-11-20T12:11:08.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:11:08.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:11:08.115 INFO:teuthology.orchestra.run.smithi160:> true 2020-11-20T12:11:08.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:11:08.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:11:08.345 INFO:teuthology.orchestra.run.smithi150:> true 2020-11-20T12:11:08.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:11:08.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:11:08.619 INFO:teuthology.orchestra.run.smithi134:> true 2020-11-20T12:11:09.004 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T12:11:09.034 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T12:11:09.034 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T12:11:09.035 INFO:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T12:11:09.167 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T12:11:09.230 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T12:11:09.342 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2020-11-20T12:11:09.390 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2020-11-20T12:11:09.450 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T12:11:09.507 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T12:11:09.616 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2020-11-20T12:11:09.623 INFO:teuthology.orchestra.run.smithi160.stdout:210 Number of sources = 4 2020-11-20T12:11:09.623 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T12:11:09.624 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2020-11-20T12:11:09.624 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.624 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.625 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.625 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.627 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T12:11:09.627 INFO:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T12:11:09.672 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T12:11:09.691 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T12:11:09.733 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2020-11-20T12:11:09.748 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2020-11-20T12:11:09.766 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T12:11:09.784 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T12:11:09.850 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2020-11-20T12:11:09.853 INFO:teuthology.orchestra.run.smithi150.stdout:210 Number of sources = 4 2020-11-20T12:11:09.853 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T12:11:09.853 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2020-11-20T12:11:09.853 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.854 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.854 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.854 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:09.854 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T12:11:09.855 INFO:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T12:11:09.899 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T12:11:09.919 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T12:11:09.963 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2020-11-20T12:11:09.977 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2020-11-20T12:11:09.995 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T12:11:10.012 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T12:11:10.078 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2020-11-20T12:11:10.081 INFO:teuthology.orchestra.run.smithi134.stdout:210 Number of sources = 4 2020-11-20T12:11:10.082 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T12:11:10.082 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2020-11-20T12:11:10.082 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:10.082 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:10.083 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:10.083 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:10.083 INFO:teuthology.run_tasks:Running task install... 2020-11-20T12:11:10.093 DEBUG:teuthology.task.install:project ceph 2020-11-20T12:11:10.094 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}} 2020-11-20T12:11:10.094 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'} 2020-11-20T12:11:10.095 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T12:11:10.101 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T12:11:10.102 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T12:11:10.102 INFO:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2020-11-20T12:11:10.250 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS 2020-11-20T12:11:10.254 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:11:10.254 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2020-11-20T12:11:10.255 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T12:11:10.256 INFO:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2020-11-20T12:11:10.294 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS 2020-11-20T12:11:10.295 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:11:10.295 INFO:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2020-11-20T12:11:10.296 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T12:11:10.296 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2020-11-20T12:11:10.334 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS 2020-11-20T12:11:10.335 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:11:10.336 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T12:11:10.336 INFO:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2020-11-20T12:11:10.372 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS 2020-11-20T12:11:10.373 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:11:10.374 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:11:10.397 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS 2020-11-20T12:11:10.401 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:11:10.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:11:10.412 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS 2020-11-20T12:11:10.413 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:11:10.413 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:11:10.538 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T12:11:10.538 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T12:11:10.565 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T12:11:10.566 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T12:11:10.571 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T12:11:10.571 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T12:11:10.698 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T12:11:10.699 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:11:10.699 INFO:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:10.701 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T12:11:10.702 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:11:10.702 INFO:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:10.704 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T12:11:10.705 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:11:10.705 INFO:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:10.718 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:10.718 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:10.732 INFO:teuthology.orchestra.run.smithi134.stderr:1+1 records in 2020-11-20T12:11:10.732 INFO:teuthology.orchestra.run.smithi134.stderr:1+1 records out 2020-11-20T12:11:10.733 INFO:teuthology.orchestra.run.smithi134.stderr:676 bytes copied, 3.6494e-05 s, 18.5 MB/s 2020-11-20T12:11:10.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T12:11:10.734 INFO:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T12:11:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:1+1 records in 2020-11-20T12:11:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:1+1 records out 2020-11-20T12:11:10.735 INFO:teuthology.orchestra.run.smithi150.stderr:676 bytes copied, 3.928e-05 s, 17.2 MB/s 2020-11-20T12:11:10.735 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T12:11:10.736 INFO:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T12:11:10.759 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:10.800 INFO:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T12:11:10.803 INFO:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T12:11:10.805 INFO:teuthology.orchestra.run.smithi160.stderr:1+1 records in 2020-11-20T12:11:10.806 INFO:teuthology.orchestra.run.smithi160.stderr:1+1 records out 2020-11-20T12:11:10.806 INFO:teuthology.orchestra.run.smithi160.stderr:676 bytes copied, 0.000138187 s, 4.9 MB/s 2020-11-20T12:11:10.809 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T12:11:10.810 INFO:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T12:11:10.881 INFO:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T12:11:10.884 INFO:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T12:11:10.911 INFO:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T12:11:10.948 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2020-11-20T12:11:10.949 INFO:teuthology.orchestra.run.smithi134:> sudo yum clean all 2020-11-20T12:11:10.950 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2020-11-20T12:11:10.951 INFO:teuthology.orchestra.run.smithi150:> sudo yum clean all 2020-11-20T12:11:11.067 INFO:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T12:11:11.168 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2020-11-20T12:11:11.172 INFO:teuthology.orchestra.run.smithi160:> sudo yum clean all 2020-11-20T12:11:11.256 INFO:teuthology.orchestra.run.smithi134.stdout:42 files removed 2020-11-20T12:11:11.270 INFO:teuthology.orchestra.run.smithi150.stdout:42 files removed 2020-11-20T12:11:11.285 INFO:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T12:11:11.301 INFO:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T12:11:11.631 INFO:teuthology.orchestra.run.smithi160.stdout:42 files removed 2020-11-20T12:11:11.676 INFO:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T12:11:11.878 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 288 kB/s | 72 kB 00:00 2020-11-20T12:11:11.892 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 290 kB/s | 72 kB 00:00 2020-11-20T12:11:12.114 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 73 kB/s | 15 kB 00:00 2020-11-20T12:11:12.128 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 73 kB/s | 15 kB 00:00 2020-11-20T12:11:12.343 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2020-11-20T12:11:12.354 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2020-11-20T12:11:12.493 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 280 kB/s | 72 kB 00:00 2020-11-20T12:11:12.526 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-8 - AppStream 43 MB/s | 7.0 MB 00:00 2020-11-20T12:11:12.572 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS-8 - AppStream 35 MB/s | 7.0 MB 00:00 2020-11-20T12:11:12.806 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 64 kB/s | 15 kB 00:00 2020-11-20T12:11:13.106 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 6.1 kB/s | 1.4 kB 00:00 2020-11-20T12:11:13.345 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-8 - AppStream 39 MB/s | 7.0 MB 00:00 2020-11-20T12:11:13.719 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-11-20T12:11:13.774 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS-8 - Base 25 MB/s | 2.2 MB 00:00 2020-11-20T12:11:14.142 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS-8 - Extras 89 kB/s | 5.5 kB 00:00 2020-11-20T12:11:14.205 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS-8 - Extras 88 kB/s | 5.5 kB 00:00 2020-11-20T12:11:14.721 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-8 - Base 24 MB/s | 2.2 MB 00:00 2020-11-20T12:11:14.729 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 16 MB/s | 8.3 MB 00:00 2020-11-20T12:11:14.878 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 13 MB/s | 8.3 MB 00:00 2020-11-20T12:11:15.181 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS-8 - Extras 84 kB/s | 5.5 kB 00:00 2020-11-20T12:11:15.829 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 14 MB/s | 8.3 MB 00:00 2020-11-20T12:11:16.515 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 4.6 MB/s | 23 kB 00:00 2020-11-20T12:11:16.597 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 5.0 MB/s | 23 kB 00:00 2020-11-20T12:11:17.445 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:17.445 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:17.449 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T12:11:17.449 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T12:11:17.450 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T12:11:17.450 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T12:11:17.451 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T12:11:17.452 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T12:11:17.452 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T12:11:17.519 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:17.520 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:17.523 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T12:11:17.524 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T12:11:17.525 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T12:11:17.525 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T12:11:17.525 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T12:11:17.526 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T12:11:17.526 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T12:11:17.585 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2020-11-20T12:11:17.602 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2020-11-20T12:11:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: Package ArchVersion Repository Size 2020-11-20T12:11:17.603 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2020-11-20T12:11:17.603 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2020-11-20T12:11:17.603 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T12:11:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T12:11:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T12:11:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T12:11:17.604 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T12:11:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T12:11:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T12:11:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T12:11:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T12:11:17.605 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T12:11:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T12:11:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T12:11:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T12:11:17.606 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T12:11:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T12:11:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T12:11:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T12:11:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T12:11:17.607 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T12:11:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T12:11:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T12:11:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T12:11:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T12:11:17.608 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T12:11:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T12:11:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T12:11:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T12:11:17.609 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T12:11:17.610 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2020-11-20T12:11:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T12:11:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T12:11:17.610 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T12:11:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T12:11:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T12:11:17.611 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2020-11-20T12:11:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T12:11:17.611 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T12:11:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T12:11:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T12:11:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T12:11:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T12:11:17.612 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T12:11:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T12:11:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T12:11:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T12:11:17.613 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T12:11:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T12:11:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T12:11:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T12:11:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T12:11:17.614 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T12:11:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T12:11:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T12:11:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T12:11:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T12:11:17.615 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T12:11:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T12:11:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T12:11:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T12:11:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T12:11:17.616 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T12:11:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T12:11:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T12:11:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T12:11:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T12:11:17.617 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T12:11:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T12:11:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T12:11:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T12:11:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T12:11:17.618 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T12:11:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T12:11:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T12:11:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T12:11:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T12:11:17.619 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T12:11:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T12:11:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T12:11:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T12:11:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T12:11:17.620 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T12:11:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T12:11:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T12:11:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T12:11:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T12:11:17.621 INFO:teuthology.orchestra.run.smithi134.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T12:11:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T12:11:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T12:11:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T12:11:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T12:11:17.622 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T12:11:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T12:11:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T12:11:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T12:11:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T12:11:17.623 INFO:teuthology.orchestra.run.smithi134.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T12:11:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T12:11:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T12:11:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T12:11:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T12:11:17.624 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T12:11:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T12:11:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T12:11:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T12:11:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T12:11:17.625 INFO:teuthology.orchestra.run.smithi134.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T12:11:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T12:11:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T12:11:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T12:11:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T12:11:17.626 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T12:11:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T12:11:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T12:11:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T12:11:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T12:11:17.627 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T12:11:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T12:11:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T12:11:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T12:11:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T12:11:17.628 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T12:11:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T12:11:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T12:11:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T12:11:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T12:11:17.629 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T12:11:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T12:11:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T12:11:17.630 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2020-11-20T12:11:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T12:11:17.630 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T12:11:17.631 INFO:teuthology.orchestra.run.smithi134.stdout:Downgrading: 2020-11-20T12:11:17.631 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T12:11:17.631 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T12:11:17.631 INFO:teuthology.orchestra.run.smithi134.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T12:11:17.631 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T12:11:17.632 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T12:11:17.632 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:11:17.632 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2020-11-20T12:11:17.632 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2020-11-20T12:11:17.632 INFO:teuthology.orchestra.run.smithi134.stdout:Install 126 Packages 2020-11-20T12:11:17.633 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 6 Packages 2020-11-20T12:11:17.633 INFO:teuthology.orchestra.run.smithi134.stdout:Downgrade 5 Packages 2020-11-20T12:11:17.633 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:11:17.634 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 202 M 2020-11-20T12:11:17.634 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2020-11-20T12:11:17.658 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2020-11-20T12:11:17.661 INFO:teuthology.orchestra.run.smithi134.stdout:(1/137): krb5-libs-1.17-9.el8.x86_64.rpm 20 MB/s | 851 kB 00:00 2020-11-20T12:11:17.671 INFO:teuthology.orchestra.run.smithi134.stdout:(2/137): krb5-workstation-1.17-9.el8.x86_64.rpm 17 MB/s | 940 kB 00:00 2020-11-20T12:11:17.678 INFO:teuthology.orchestra.run.smithi134.stdout:(3/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 40 MB/s | 686 kB 00:00 2020-11-20T12:11:17.678 INFO:teuthology.orchestra.run.smithi134.stdout:(4/137): libkadm5-1.17-9.el8.x86_64.rpm 3.0 MB/s | 184 kB 00:00 2020-11-20T12:11:17.686 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2020-11-20T12:11:17.686 INFO:teuthology.orchestra.run.smithi150.stdout: Package ArchVersion Repository Size 2020-11-20T12:11:17.687 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2020-11-20T12:11:17.687 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2020-11-20T12:11:17.687 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T12:11:17.688 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T12:11:17.688 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T12:11:17.688 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:17.688 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T12:11:17.689 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T12:11:17.689 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T12:11:17.689 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T12:11:17.689 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T12:11:17.690 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T12:11:17.690 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:17.690 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T12:11:17.690 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T12:11:17.691 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T12:11:17.691 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T12:11:17.691 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T12:11:17.691 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T12:11:17.691 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T12:11:17.692 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T12:11:17.692 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T12:11:17.692 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T12:11:17.693 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T12:11:17.693 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T12:11:17.694 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T12:11:17.694 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T12:11:17.694 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T12:11:17.694 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T12:11:17.695 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T12:11:17.695 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T12:11:17.695 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T12:11:17.695 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2020-11-20T12:11:17.696 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:17.696 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T12:11:17.696 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T12:11:17.696 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T12:11:17.697 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T12:11:17.697 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T12:11:17.697 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2020-11-20T12:11:17.697 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T12:11:17.698 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T12:11:17.698 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T12:11:17.698 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T12:11:17.698 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T12:11:17.699 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T12:11:17.699 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:17.699 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T12:11:17.699 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T12:11:17.700 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T12:11:17.700 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T12:11:17.700 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T12:11:17.700 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T12:11:17.701 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T12:11:17.701 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T12:11:17.701 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T12:11:17.701 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T12:11:17.701 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T12:11:17.702 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T12:11:17.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T12:11:17.702 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T12:11:17.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T12:11:17.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T12:11:17.703 INFO:teuthology.orchestra.run.smithi150.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T12:11:17.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T12:11:17.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T12:11:17.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T12:11:17.704 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T12:11:17.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T12:11:17.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T12:11:17.705 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T12:11:17.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T12:11:17.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T12:11:17.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T12:11:17.706 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T12:11:17.707 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T12:11:17.707 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T12:11:17.707 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T12:11:17.707 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T12:11:17.708 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T12:11:17.708 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T12:11:17.708 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T12:11:17.709 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T12:11:17.709 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T12:11:17.709 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T12:11:17.709 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T12:11:17.710 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T12:11:17.710 INFO:teuthology.orchestra.run.smithi150.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T12:11:17.710 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T12:11:17.710 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T12:11:17.711 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T12:11:17.711 INFO:teuthology.orchestra.run.smithi150.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T12:11:17.711 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T12:11:17.711 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T12:11:17.712 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T12:11:17.712 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T12:11:17.712 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T12:11:17.712 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T12:11:17.713 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T12:11:17.713 INFO:teuthology.orchestra.run.smithi150.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T12:11:17.713 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T12:11:17.714 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T12:11:17.714 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T12:11:17.714 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T12:11:17.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T12:11:17.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T12:11:17.715 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T12:11:17.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T12:11:17.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T12:11:17.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T12:11:17.716 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T12:11:17.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T12:11:17.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T12:11:17.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T12:11:17.717 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T12:11:17.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T12:11:17.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T12:11:17.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T12:11:17.718 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T12:11:17.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T12:11:17.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T12:11:17.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T12:11:17.719 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T12:11:17.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T12:11:17.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T12:11:17.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T12:11:17.720 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T12:11:17.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T12:11:17.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T12:11:17.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T12:11:17.721 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T12:11:17.722 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T12:11:17.722 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T12:11:17.722 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T12:11:17.722 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2020-11-20T12:11:17.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T12:11:17.723 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T12:11:17.723 INFO:teuthology.orchestra.run.smithi150.stdout:Downgrading: 2020-11-20T12:11:17.723 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T12:11:17.724 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T12:11:17.724 INFO:teuthology.orchestra.run.smithi150.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T12:11:17.724 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T12:11:17.725 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T12:11:17.725 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:11:17.725 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2020-11-20T12:11:17.726 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2020-11-20T12:11:17.726 INFO:teuthology.orchestra.run.smithi150.stdout:Install 126 Packages 2020-11-20T12:11:17.726 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 6 Packages 2020-11-20T12:11:17.726 INFO:teuthology.orchestra.run.smithi150.stdout:Downgrade 5 Packages 2020-11-20T12:11:17.726 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:11:17.727 INFO:teuthology.orchestra.run.smithi134.stdout:(5/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 67 MB/s | 1.5 MB 00:00 2020-11-20T12:11:17.728 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 202 M 2020-11-20T12:11:17.728 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2020-11-20T12:11:17.744 INFO:teuthology.orchestra.run.smithi150.stdout:(1/137): krb5-libs-1.17-9.el8.x86_64.rpm 20 MB/s | 851 kB 00:00 2020-11-20T12:11:17.747 INFO:teuthology.orchestra.run.smithi150.stdout:(2/137): libkadm5-1.17-9.el8.x86_64.rpm 4.0 MB/s | 184 kB 00:00 2020-11-20T12:11:17.758 INFO:teuthology.orchestra.run.smithi150.stdout:(3/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 47 MB/s | 686 kB 00:00 2020-11-20T12:11:17.771 INFO:teuthology.orchestra.run.smithi150.stdout:(4/137): krb5-workstation-1.17-9.el8.x86_64.rpm 14 MB/s | 940 kB 00:00 2020-11-20T12:11:17.779 INFO:teuthology.orchestra.run.smithi134.stdout:(6/137): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 63 kB/s | 6.4 kB 00:00 2020-11-20T12:11:17.781 INFO:teuthology.orchestra.run.smithi150.stdout:(5/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 43 MB/s | 1.5 MB 00:00 2020-11-20T12:11:17.783 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 3.9 MB/s | 23 kB 00:00 2020-11-20T12:11:17.857 INFO:teuthology.orchestra.run.smithi150.stdout:(6/137): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 65 kB/s | 6.4 kB 00:00 2020-11-20T12:11:17.930 INFO:teuthology.orchestra.run.smithi134.stdout:(7/137): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 4.1 MB/s | 632 kB 00:00 2020-11-20T12:11:17.972 INFO:teuthology.orchestra.run.smithi134.stdout:(8/137): ceph-immutable-object-cache-16.0.0-739 4.7 MB/s | 204 kB 00:00 2020-11-20T12:11:18.264 INFO:teuthology.orchestra.run.smithi134.stdout:(9/137): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 7.4 MB/s | 2.1 MB 00:00 2020-11-20T12:11:18.345 INFO:teuthology.orchestra.run.smithi150.stdout:(7/137): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 1.3 MB/s | 632 kB 00:00 2020-11-20T12:11:18.476 INFO:teuthology.orchestra.run.smithi134.stdout:(10/137): ceph-mgr-16.0.0-7397.gb86e691b.el8.x8 7.3 MB/s | 1.5 MB 00:00 2020-11-20T12:11:18.490 INFO:teuthology.orchestra.run.smithi150.stdout:(8/137): ceph-immutable-object-cache-16.0.0-739 1.4 MB/s | 204 kB 00:00 2020-11-20T12:11:18.530 INFO:teuthology.orchestra.run.smithi134.stdout:(11/137): ceph-base-16.0.0-7397.gb86e691b.el8.x 7.0 MB/s | 6.0 MB 00:00 2020-11-20T12:11:18.741 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:18.742 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:18.747 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.20.0-3.el8.x86_64 is already installed. 2020-11-20T12:11:18.748 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-4.18.0-15.el8.x86_64 is already installed. 2020-11-20T12:11:18.749 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.32.1-17.el8.x86_64 is already installed. 2020-11-20T12:11:18.749 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T12:11:18.750 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T12:11:18.752 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T12:11:18.753 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-11-20T12:11:18.906 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2020-11-20T12:11:18.926 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2020-11-20T12:11:18.926 INFO:teuthology.orchestra.run.smithi160.stdout: Package ArchVersion Repository Size 2020-11-20T12:11:18.926 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2020-11-20T12:11:18.927 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2020-11-20T12:11:18.927 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T12:11:18.927 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_642:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T12:11:18.927 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T12:11:18.928 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:18.928 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_642:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T12:11:18.928 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T12:11:18.928 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_642:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T12:11:18.928 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T12:11:18.929 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T12:11:18.929 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_642:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T12:11:18.929 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_642:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:18.929 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_642:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T12:11:18.929 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T12:11:18.930 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_642:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T12:11:18.930 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_642:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T12:11:18.930 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T12:11:18.930 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_642:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T12:11:18.930 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T12:11:18.931 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T12:11:18.931 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T12:11:18.931 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T12:11:18.931 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T12:11:18.932 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_643.0.4-10.el8 CentOS-AppStream 688 k 2020-11-20T12:11:18.932 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_642.6.1-9.el8 CentOS-AppStream 320 k 2020-11-20T12:11:18.932 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_642.4.6-25.el8 CentOS-AppStream 709 k 2020-11-20T12:11:18.932 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_640.176-5.el8 CentOS-Base 54 k 2020-11-20T12:11:18.932 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_640.3.112-1.el8 CentOS-Base 19 k 2020-11-20T12:11:18.933 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_642.32.1-17.el8 CentOS-Base 95 k 2020-11-20T12:11:18.933 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_641:1.1.1c-2.el8_1.1 CentOS-Base 2.3 M 2020-11-20T12:11:18.933 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_645.0.0-1.el8 CentOS-Base 69 k 2020-11-20T12:11:18.933 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2020-11-20T12:11:18.934 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:18.934 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T12:11:18.934 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_641:1.20.0-5.el8_1 CentOS-Base 2.1 M 2020-11-20T12:11:18.934 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_641:1.20.0-5.el8_1 CentOS-Base 1.7 M 2020-11-20T12:11:18.934 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_641:1.20.0-5.el8_1 CentOS-Base 133 k 2020-11-20T12:11:18.935 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_641:1.20.0-5.el8_1 CentOS-Base 308 k 2020-11-20T12:11:18.935 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2020-11-20T12:11:18.935 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T12:11:18.935 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_642:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T12:11:18.935 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_642:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T12:11:18.936 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_642:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T12:11:18.936 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_642:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T12:11:18.936 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_642:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T12:11:18.936 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_642:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:18.936 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_642:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T12:11:18.937 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_642:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T12:11:18.937 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T12:11:18.937 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T12:11:18.937 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T12:11:18.938 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch1.16.1-6.el8 CentOS-AppStream 713 k 2020-11-20T12:11:18.938 INFO:teuthology.orchestra.run.smithi160.stdout: jq x86_641.5-12.el8 CentOS-AppStream 161 k 2020-11-20T12:11:18.938 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_640.11.4-1.el8 CentOS-AppStream 353 k 2020-11-20T12:11:18.938 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_642.8.1-11.el8 CentOS-AppStream 259 k 2020-11-20T12:11:18.938 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma x86_646.8.2-1.el8 CentOS-AppStream 188 k 2020-11-20T12:11:18.939 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_640.3.3-2.el8 CentOS-AppStream 4.3 M 2020-11-20T12:11:18.939 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads x86_640.3.3-2.el8 CentOS-AppStream 4.4 M 2020-11-20T12:11:18.939 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch2.5.1-5.el8 CentOS-AppStream 4.8 M 2020-11-20T12:11:18.939 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch2.10.1-2.el8_0 CentOS-AppStream 538 k 2020-11-20T12:11:18.939 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch1.21-2.el8 CentOS-AppStream 27 k 2020-11-20T12:11:18.940 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch1.10-11.el8 CentOS-AppStream 20 k 2020-11-20T12:11:18.940 INFO:teuthology.orchestra.run.smithi160.stdout: python3-lxml x86_644.2.3-1.el8 CentOS-AppStream 1.5 M 2020-11-20T12:11:18.940 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch1.0.6-13.el8 CentOS-AppStream 157 k 2020-11-20T12:11:18.940 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_640.23-19.el8 CentOS-AppStream 39 k 2020-11-20T12:11:18.940 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_641:1.14.3-9.el8 CentOS-AppStream 3.7 M 2020-11-20T12:11:18.941 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 CentOS-AppStream 225 k 2020-11-20T12:11:18.941 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch0.7.2-14.el8 CentOS-AppStream 44 k 2020-11-20T12:11:18.941 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch0.3.7-6.el8 CentOS-AppStream 126 k 2020-11-20T12:11:18.941 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 CentOS-AppStream 110 k 2020-11-20T12:11:18.941 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch2017.2-9.el8 CentOS-AppStream 54 k 2020-11-20T12:11:18.942 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f CentOS-AppStream 15 M 2020-11-20T12:11:18.942 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webencodings noarch0.5.1-6.el8 CentOS-AppStream 27 k 2020-11-20T12:11:18.942 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch0.12.2-4.el8 CentOS-AppStream 457 k 2020-11-20T12:11:18.942 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_641.7.3.2-6.el8 CentOS-AppStream 298 k 2020-11-20T12:11:18.942 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_642.9.7-12.el8 CentOS-Base 82 k 2020-11-20T12:11:18.943 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-common x86_643.2.1-12.el8 CentOS-Base 21 k 2020-11-20T12:11:18.943 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel x86_641.5.10-6.el8 CentOS-Base 48 k 2020-11-20T12:11:18.943 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel x86_641.17-9.el8 CentOS-Base 548 k 2020-11-20T12:11:18.943 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel x86_641.44.6-3.el8 CentOS-Base 38 k 2020-11-20T12:11:18.943 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_648.3.1-4.5.el8 CentOS-Base 638 k 2020-11-20T12:11:18.944 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_648.3.1-4.5.el8 CentOS-Base 169 k 2020-11-20T12:11:18.944 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_640.9.0-1.el8 CentOS-Base 47 k 2020-11-20T12:11:18.944 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel x86_642.9-2.1.el8 CentOS-Base 199 k 2020-11-20T12:11:18.944 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel x86_642.9-1.el8 CentOS-Base 86 k 2020-11-20T12:11:18.944 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel x86_640.3.0-5.el8 CentOS-Base 18 k 2020-11-20T12:11:18.945 INFO:teuthology.orchestra.run.smithi160.stdout: libxslt x86_641.1.32-3.el8 CentOS-Base 249 k 2020-11-20T12:11:18.945 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel x86_6410.32-1.el8 CentOS-Base 605 k 2020-11-20T12:11:18.945 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16 x86_6410.32-1.el8 CentOS-Base 228 k 2020-11-20T12:11:18.945 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32 x86_6410.32-1.el8 CentOS-Base 220 k 2020-11-20T12:11:18.946 INFO:teuthology.orchestra.run.smithi160.stdout: python3-chardet noarch3.0.4-7.el8 CentOS-Base 195 k 2020-11-20T12:11:18.946 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt noarch1.6.1-2.el8 CentOS-Base 43 k 2020-11-20T12:11:18.946 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch2.1.0-1.el8 CentOS-Base 155 k 2020-11-20T12:11:18.946 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pysocks noarch1.6.8-3.el8 CentOS-Base 34 k 2020-11-20T12:11:18.946 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch2.20.0-2.1.el8_1 CentOS-Base 123 k 2020-11-20T12:11:18.947 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 CentOS-Base 43 k 2020-11-20T12:11:18.947 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch1.24.2-2.el8 CentOS-Base 176 k 2020-11-20T12:11:18.947 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_641.2.11-10.el8 CentOS-Base 56 k 2020-11-20T12:11:18.947 INFO:teuthology.orchestra.run.smithi160.stdout: fmt x86_646.2.1-1.el8 epel 116 k 2020-11-20T12:11:18.947 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-11-20T12:11:18.948 INFO:teuthology.orchestra.run.smithi160.stdout: leveldb x86_641.22-1.el8 epel 181 k 2020-11-20T12:11:18.948 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-11-20T12:11:18.948 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-11-20T12:11:18.948 INFO:teuthology.orchestra.run.smithi160.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-11-20T12:11:18.948 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-11-20T12:11:18.949 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-11-20T12:11:18.949 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-11-20T12:11:18.949 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-11-20T12:11:18.949 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch8.2.1-1.el8 epel 145 k 2020-11-20T12:11:18.949 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch18.4.0-1.el8 epel 384 k 2020-11-20T12:11:18.950 INFO:teuthology.orchestra.run.smithi160.stdout: python3-execnet noarch1.7.1-1.el8 epel 355 k 2020-11-20T12:11:18.950 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-11-20T12:11:18.950 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch6.2-6.el8 epel 11 k 2020-11-20T12:11:18.950 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch2.0-4.el8 epel 18 k 2020-11-20T12:11:18.950 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch11.0.0-2.el8 epel 1.2 M 2020-11-20T12:11:18.951 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch0.3.5-11.el8 epel 49 k 2020-11-20T12:11:18.951 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch7.2.0-3.el8 epel 59 k 2020-11-20T12:11:18.951 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch1.3.2-9.el8 epel 283 k 2020-11-20T12:11:18.951 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch2.6-1.el8 epel 16 k 2020-11-20T12:11:18.951 INFO:teuthology.orchestra.run.smithi160.stdout: python3-remoto noarch1.1.4-4.el8 epel 48 k 2020-11-20T12:11:18.952 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch0.7-6.el8 epel 34 k 2020-11-20T12:11:18.952 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch2.4.1-12.el8 epel 196 k 2020-11-20T12:11:18.952 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch3.4.2-15.el8 epel 73 k 2020-11-20T12:11:18.952 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric noarch0.8.1-17.el8 epel 19 k 2020-11-20T12:11:18.952 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch noarch3.4.0.3-18.el8 epel 24 k 2020-11-20T12:11:18.953 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch1.14.1-5.el8 epel 29 k 2020-11-20T12:11:18.953 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme noarch0.6.0-4.el8 epel 27 k 2020-11-20T12:11:18.953 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-11-20T12:11:18.953 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-11-20T12:11:18.954 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-11-20T12:11:18.954 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-11-20T12:11:18.954 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch2.0-2.el8 epel 23 k 2020-11-20T12:11:18.954 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_641.6.1-11.el8 epel 69 k 2020-11-20T12:11:18.954 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2020-11-20T12:11:18.955 INFO:teuthology.orchestra.run.smithi160.stdout: python3-html5lib noarch1:0.999999999-6.el8 CentOS-AppStream 214 k 2020-11-20T12:11:18.955 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-11-20T12:11:18.955 INFO:teuthology.orchestra.run.smithi160.stdout:Downgrading: 2020-11-20T12:11:18.955 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-libs x86_641.17-9.el8 CentOS-Base 851 k 2020-11-20T12:11:18.955 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-workstation x86_641.17-9.el8 CentOS-Base 940 k 2020-11-20T12:11:18.956 INFO:teuthology.orchestra.run.smithi160.stdout: libkadm5 x86_641.17-9.el8 CentOS-Base 184 k 2020-11-20T12:11:18.956 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_641:1.1.1c-2.el8_1.1 CentOS-Base 686 k 2020-11-20T12:11:18.956 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_641:1.1.1c-2.el8_1.1 CentOS-Base 1.5 M 2020-11-20T12:11:18.956 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:11:18.956 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2020-11-20T12:11:18.957 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2020-11-20T12:11:18.957 INFO:teuthology.orchestra.run.smithi160.stdout:Install 126 Packages 2020-11-20T12:11:18.957 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 6 Packages 2020-11-20T12:11:18.957 INFO:teuthology.orchestra.run.smithi160.stdout:Downgrade 5 Packages 2020-11-20T12:11:18.958 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:11:18.959 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 202 M 2020-11-20T12:11:18.959 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2020-11-20T12:11:19.064 INFO:teuthology.orchestra.run.smithi134.stdout:(12/137): ceph-mon-16.0.0-7397.gb86e691b.el8.x8 8.4 MB/s | 5.0 MB 00:00 2020-11-20T12:11:19.702 INFO:teuthology.orchestra.run.smithi160.stdout:(1/137): libkadm5-1.17-9.el8.x86_64.rpm 245 kB/s | 184 kB 00:00 2020-11-20T12:11:19.718 INFO:teuthology.orchestra.run.smithi160.stdout:(2/137): krb5-libs-1.17-9.el8.x86_64.rpm 1.1 MB/s | 851 kB 00:00 2020-11-20T12:11:19.741 INFO:teuthology.orchestra.run.smithi160.stdout:(3/137): openssl-1.1.1c-2.el8_1.1.x86_64.rpm 17 MB/s | 686 kB 00:00 2020-11-20T12:11:19.763 INFO:teuthology.orchestra.run.smithi160.stdout:(4/137): openssl-libs-1.1.1c-2.el8_1.1.x86_64.r 33 MB/s | 1.5 MB 00:00 2020-11-20T12:11:19.841 INFO:teuthology.orchestra.run.smithi150.stdout:(9/137): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.6 MB/s | 2.1 MB 00:01 2020-11-20T12:11:19.935 INFO:teuthology.orchestra.run.smithi160.stdout:(5/137): krb5-workstation-1.17-9.el8.x86_64.rpm 953 kB/s | 940 kB 00:00 2020-11-20T12:11:20.027 INFO:teuthology.orchestra.run.smithi160.stdout:(6/137): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2020-11-20T12:11:20.543 INFO:teuthology.orchestra.run.smithi160.stdout:(7/137): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 1.2 MB/s | 632 kB 00:00 2020-11-20T12:11:20.571 INFO:teuthology.orchestra.run.smithi134.stdout:(13/137): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 8.8 MB/s | 18 MB 00:02 2020-11-20T12:11:20.607 INFO:teuthology.orchestra.run.smithi134.stdout:(14/137): ceph-radosgw-16.0.0-7397.gb86e691b.el 7.7 MB/s | 12 MB 00:01 2020-11-20T12:11:20.616 INFO:teuthology.orchestra.run.smithi160.stdout:(8/137): ceph-immutable-object-cache-16.0.0-739 2.8 MB/s | 204 kB 00:00 2020-11-20T12:11:20.619 INFO:teuthology.orchestra.run.smithi150.stdout:(10/137): ceph-mgr-16.0.0-7397.gb86e691b.el8.x8 2.0 MB/s | 1.5 MB 00:00 2020-11-20T12:11:20.667 INFO:teuthology.orchestra.run.smithi134.stdout:(15/137): ceph-selinux-16.0.0-7397.gb86e691b.el 257 kB/s | 25 kB 00:00 2020-11-20T12:11:20.733 INFO:teuthology.orchestra.run.smithi134.stdout:(16/137): libcephfs-devel-16.0.0-7397.gb86e691b 360 kB/s | 24 kB 00:00 2020-11-20T12:11:20.766 INFO:teuthology.orchestra.run.smithi150.stdout:(11/137): ceph-base-16.0.0-7397.gb86e691b.el8.x 2.0 MB/s | 6.0 MB 00:02 2020-11-20T12:11:21.331 INFO:teuthology.orchestra.run.smithi134.stdout:(17/137): libcephfs2-16.0.0-7397.gb86e691b.el8. 940 kB/s | 562 kB 00:00 2020-11-20T12:11:21.641 INFO:teuthology.orchestra.run.smithi160.stdout:(9/137): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 2.1 MB/s | 2.1 MB 00:01 2020-11-20T12:11:21.719 INFO:teuthology.orchestra.run.smithi134.stdout:(18/137): librados-devel-16.0.0-7397.gb86e691b. 338 kB/s | 131 kB 00:00 2020-11-20T12:11:21.797 INFO:teuthology.orchestra.run.smithi160.stdout:(10/137): ceph-base-16.0.0-7397.gb86e691b.el8.x 2.9 MB/s | 6.0 MB 00:02 2020-11-20T12:11:22.019 INFO:teuthology.orchestra.run.smithi134.stdout:(19/137): ceph-common-16.0.0-7397.gb86e691b.el8 5.3 MB/s | 23 MB 00:04 2020-11-20T12:11:22.021 INFO:teuthology.orchestra.run.smithi134.stdout:(20/137): libradosstriper1-16.0.0-7397.gb86e691 1.6 MB/s | 486 kB 00:00 2020-11-20T12:11:22.101 INFO:teuthology.orchestra.run.smithi134.stdout:(21/137): python3-ceph-argparse-16.0.0-7397.gb8 498 kB/s | 40 kB 00:00 2020-11-20T12:11:22.180 INFO:teuthology.orchestra.run.smithi134.stdout:(22/137): python3-ceph-common-16.0.0-7397.gb86e 919 kB/s | 73 kB 00:00 2020-11-20T12:11:22.592 INFO:teuthology.orchestra.run.smithi160.stdout:(11/137): ceph-mon-16.0.0-7397.gb86e691b.el8.x8 6.2 MB/s | 5.0 MB 00:00 2020-11-20T12:11:22.608 INFO:teuthology.orchestra.run.smithi160.stdout:(12/137): ceph-mgr-16.0.0-7397.gb86e691b.el8.x8 1.6 MB/s | 1.5 MB 00:00 2020-11-20T12:11:22.785 INFO:teuthology.orchestra.run.smithi134.stdout:(23/137): python3-cephfs-16.0.0-7397.gb86e691b. 338 kB/s | 204 kB 00:00 2020-11-20T12:11:23.046 INFO:teuthology.orchestra.run.smithi134.stdout:(24/137): python3-rados-16.0.0-7397.gb86e691b.e 1.4 MB/s | 375 kB 00:00 2020-11-20T12:11:23.072 INFO:teuthology.orchestra.run.smithi134.stdout:(25/137): librgw2-16.0.0-7397.gb86e691b.el8.x86 3.5 MB/s | 3.7 MB 00:01 2020-11-20T12:11:23.077 INFO:teuthology.orchestra.run.smithi150.stdout:(12/137): ceph-mon-16.0.0-7397.gb86e691b.el8.x8 2.0 MB/s | 5.0 MB 00:02 2020-11-20T12:11:23.135 INFO:teuthology.orchestra.run.smithi134.stdout:(26/137): python3-rgw-16.0.0-7397.gb86e691b.el8 1.8 MB/s | 113 kB 00:00 2020-11-20T12:11:23.177 INFO:teuthology.orchestra.run.smithi134.stdout:(27/137): python3-rbd-16.0.0-7397.gb86e691b.el8 2.6 MB/s | 353 kB 00:00 2020-11-20T12:11:23.199 INFO:teuthology.orchestra.run.smithi134.stdout:(28/137): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.4 MB/s | 88 kB 00:00 2020-11-20T12:11:23.269 INFO:teuthology.orchestra.run.smithi134.stdout:(29/137): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 2.4 MB/s | 171 kB 00:00 2020-11-20T12:11:23.335 INFO:teuthology.orchestra.run.smithi134.stdout:(30/137): ceph-grafana-dashboards-16.0.0-7397.g 368 kB/s | 24 kB 00:00 2020-11-20T12:11:23.400 INFO:teuthology.orchestra.run.smithi134.stdout:(31/137): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.0 MB/s | 66 kB 00:00 2020-11-20T12:11:23.962 INFO:teuthology.orchestra.run.smithi134.stdout:(32/137): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.1 MB/s | 3.2 MB 00:00 2020-11-20T12:11:24.542 INFO:teuthology.orchestra.run.smithi134.stdout:(33/137): ceph-mgr-dashboard-16.0.0-7397.gb86e6 2.8 MB/s | 3.2 MB 00:01 2020-11-20T12:11:24.621 INFO:teuthology.orchestra.run.smithi134.stdout:(34/137): ceph-mgr-modules-core-16.0.0-7397.gb8 2.5 MB/s | 198 kB 00:00 2020-11-20T12:11:24.688 INFO:teuthology.orchestra.run.smithi134.stdout:(35/137): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 402 kB/s | 27 kB 00:00 2020-11-20T12:11:24.753 INFO:teuthology.orchestra.run.smithi134.stdout:(36/137): ceph-prometheus-alerts-16.0.0-7397.gb 137 kB/s | 8.8 kB 00:00 2020-11-20T12:11:24.819 INFO:teuthology.orchestra.run.smithi134.stdout:(37/137): cephadm-16.0.0-7397.gb86e691b.el8.noa 879 kB/s | 57 kB 00:00 2020-11-20T12:11:24.958 INFO:teuthology.orchestra.run.smithi134.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2020-11-20T12:11:24.959 INFO:teuthology.orchestra.run.smithi134.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 79 MB/s | 688 kB 00:00 2020-11-20T12:11:24.959 INFO:teuthology.orchestra.run.smithi134.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 65 MB/s | 320 kB 00:00 2020-11-20T12:11:24.959 INFO:teuthology.orchestra.run.smithi134.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 57 MB/s | 161 kB 00:00 2020-11-20T12:11:24.959 INFO:teuthology.orchestra.run.smithi134.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 70 MB/s | 353 kB 00:00 2020-11-20T12:11:24.960 INFO:teuthology.orchestra.run.smithi134.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 79 MB/s | 709 kB 00:00 2020-11-20T12:11:24.960 INFO:teuthology.orchestra.run.smithi134.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 71 MB/s | 259 kB 00:00 2020-11-20T12:11:24.960 INFO:teuthology.orchestra.run.smithi134.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 66 MB/s | 188 kB 00:00 2020-11-20T12:11:24.960 INFO:teuthology.orchestra.run.smithi134.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 83 MB/s | 4.3 MB 00:00 2020-11-20T12:11:25.000 INFO:teuthology.orchestra.run.smithi134.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 84 MB/s | 4.4 MB 00:00 2020-11-20T12:11:25.058 INFO:teuthology.orchestra.run.smithi134.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 83 MB/s | 4.8 MB 00:00 2020-11-20T12:11:25.061 INFO:teuthology.orchestra.run.smithi134.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 61 MB/s | 214 kB 00:00 2020-11-20T12:11:25.068 INFO:teuthology.orchestra.run.smithi134.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 78 MB/s | 538 kB 00:00 2020-11-20T12:11:25.069 INFO:teuthology.orchestra.run.smithi134.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 26 MB/s | 27 kB 00:00 2020-11-20T12:11:25.070 INFO:teuthology.orchestra.run.smithi134.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 17 MB/s | 20 kB 00:00 2020-11-20T12:11:25.089 INFO:teuthology.orchestra.run.smithi134.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 84 MB/s | 1.5 MB 00:00 2020-11-20T12:11:25.093 INFO:teuthology.orchestra.run.smithi134.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 64 MB/s | 157 kB 00:00 2020-11-20T12:11:25.094 INFO:teuthology.orchestra.run.smithi134.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 33 MB/s | 39 kB 00:00 2020-11-20T12:11:25.136 INFO:teuthology.orchestra.run.smithi134.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 86 MB/s | 3.7 MB 00:00 2020-11-20T12:11:25.140 INFO:teuthology.orchestra.run.smithi134.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 59 MB/s | 225 kB 00:00 2020-11-20T12:11:25.142 INFO:teuthology.orchestra.run.smithi134.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 24 MB/s | 44 kB 00:00 2020-11-20T12:11:25.145 INFO:teuthology.orchestra.run.smithi134.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 59 MB/s | 126 kB 00:00 2020-11-20T12:11:25.146 INFO:teuthology.orchestra.run.smithi134.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 56 MB/s | 110 kB 00:00 2020-11-20T12:11:25.148 INFO:teuthology.orchestra.run.smithi134.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2020-11-20T12:11:25.309 INFO:teuthology.orchestra.run.smithi160.stdout:(13/137): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 6.6 MB/s | 18 MB 00:02 2020-11-20T12:11:25.354 INFO:teuthology.orchestra.run.smithi160.stdout:(14/137): ceph-selinux-16.0.0-7397.gb86e691b.el 588 kB/s | 25 kB 00:00 2020-11-20T12:11:25.382 INFO:teuthology.orchestra.run.smithi134.stdout:(62/137): python3-scipy-1.0.0-20.module_el8.1.0 62 MB/s | 15 MB 00:00 2020-11-20T12:11:25.383 INFO:teuthology.orchestra.run.smithi134.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 17 MB/s | 27 kB 00:00 2020-11-20T12:11:25.390 INFO:teuthology.orchestra.run.smithi134.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 71 MB/s | 457 kB 00:00 2020-11-20T12:11:25.394 INFO:teuthology.orchestra.run.smithi134.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 71 MB/s | 298 kB 00:00 2020-11-20T12:11:25.396 INFO:teuthology.orchestra.run.smithi134.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 36 MB/s | 54 kB 00:00 2020-11-20T12:11:25.397 INFO:teuthology.orchestra.run.smithi134.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 49 MB/s | 82 kB 00:00 2020-11-20T12:11:25.400 INFO:teuthology.orchestra.run.smithi134.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 11 MB/s | 21 kB 00:00 2020-11-20T12:11:25.401 INFO:teuthology.orchestra.run.smithi134.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 36 MB/s | 48 kB 00:00 2020-11-20T12:11:25.408 INFO:teuthology.orchestra.run.smithi134.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 78 MB/s | 548 kB 00:00 2020-11-20T12:11:25.409 INFO:teuthology.orchestra.run.smithi134.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 18 MB/s | 19 kB 00:00 2020-11-20T12:11:25.410 INFO:teuthology.orchestra.run.smithi134.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 31 MB/s | 38 kB 00:00 2020-11-20T12:11:25.419 INFO:teuthology.orchestra.run.smithi134.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 77 MB/s | 638 kB 00:00 2020-11-20T12:11:25.423 INFO:teuthology.orchestra.run.smithi134.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 36 MB/s | 169 kB 00:00 2020-11-20T12:11:25.426 INFO:teuthology.orchestra.run.smithi134.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 38 MB/s | 47 kB 00:00 2020-11-20T12:11:25.428 INFO:teuthology.orchestra.run.smithi134.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 68 MB/s | 199 kB 00:00 2020-11-20T12:11:25.430 INFO:teuthology.orchestra.run.smithi134.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 51 MB/s | 86 kB 00:00 2020-11-20T12:11:25.431 INFO:teuthology.orchestra.run.smithi134.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 54 MB/s | 95 kB 00:00 2020-11-20T12:11:25.432 INFO:teuthology.orchestra.run.smithi134.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2020-11-20T12:11:25.436 INFO:teuthology.orchestra.run.smithi134.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 70 MB/s | 249 kB 00:00 2020-11-20T12:11:25.464 INFO:teuthology.orchestra.run.smithi134.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 84 MB/s | 2.3 MB 00:00 2020-11-20T12:11:25.488 INFO:teuthology.orchestra.run.smithi134.stdout:(82/137): ceph-mgr-diskprediction-local-16.0.0- 5.6 MB/s | 8.6 MB 00:01 2020-11-20T12:11:25.495 INFO:teuthology.orchestra.run.smithi134.stdout:(83/137): pcre2-devel-10.32-1.el8.x86_64.rpm 19 MB/s | 605 kB 00:00 2020-11-20T12:11:25.500 INFO:teuthology.orchestra.run.smithi134.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 52 MB/s | 220 kB 00:00 2020-11-20T12:11:25.509 INFO:teuthology.orchestra.run.smithi134.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 20 MB/s | 195 kB 00:00 2020-11-20T12:11:25.512 INFO:teuthology.orchestra.run.smithi134.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 18 MB/s | 43 kB 00:00 2020-11-20T12:11:25.518 INFO:teuthology.orchestra.run.smithi134.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 23 MB/s | 155 kB 00:00 2020-11-20T12:11:25.522 INFO:teuthology.orchestra.run.smithi134.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 10 MB/s | 34 kB 00:00 2020-11-20T12:11:25.524 INFO:teuthology.orchestra.run.smithi134.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 54 MB/s | 123 kB 00:00 2020-11-20T12:11:25.525 INFO:teuthology.orchestra.run.smithi134.stdout:(90/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 6.0 MB/s | 228 kB 00:00 2020-11-20T12:11:25.526 INFO:teuthology.orchestra.run.smithi134.stdout:(91/137): python3-requests-oauthlib-1.0.0-1.el8 30 MB/s | 43 kB 00:00 2020-11-20T12:11:25.528 INFO:teuthology.orchestra.run.smithi134.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 29 MB/s | 69 kB 00:00 2020-11-20T12:11:25.529 INFO:teuthology.orchestra.run.smithi134.stdout:(93/137): python3-urllib3-1.24.2-2.el8.noarch.r 46 MB/s | 176 kB 00:00 2020-11-20T12:11:25.530 INFO:teuthology.orchestra.run.smithi134.stdout:(94/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 38 MB/s | 56 kB 00:00 2020-11-20T12:11:25.611 INFO:teuthology.orchestra.run.smithi134.stdout:(95/137): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2020-11-20T12:11:25.628 INFO:teuthology.orchestra.run.smithi134.stdout:(96/137): gperftools-libs-2.7-6.el8.x86_64.rpm 3.2 MB/s | 315 kB 00:00 2020-11-20T12:11:25.643 INFO:teuthology.orchestra.run.smithi134.stdout:(97/137): leveldb-1.22-1.el8.x86_64.rpm 5.5 MB/s | 181 kB 00:00 2020-11-20T12:11:25.644 INFO:teuthology.orchestra.run.smithi134.stdout:(98/137): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-11-20T12:11:25.660 INFO:teuthology.orchestra.run.smithi134.stdout:(99/137): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T12:11:25.661 INFO:teuthology.orchestra.run.smithi134.stdout:(100/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-11-20T12:11:25.677 INFO:teuthology.orchestra.run.smithi134.stdout:(101/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.6 MB/s | 44 kB 00:00 2020-11-20T12:11:25.680 INFO:teuthology.orchestra.run.smithi134.stdout:(102/137): python3-beautifulsoup4-4.6.3-2.el8.1 9.9 MB/s | 185 kB 00:00 2020-11-20T12:11:25.693 INFO:teuthology.orchestra.run.smithi134.stdout:(103/137): python3-cachetools-3.1.1-4.el8.noarc 2.0 MB/s | 33 kB 00:00 2020-11-20T12:11:25.696 INFO:teuthology.orchestra.run.smithi134.stdout:(104/137): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-11-20T12:11:25.711 INFO:teuthology.orchestra.run.smithi134.stdout:(105/137): python3-cheroot-8.2.1-1.el8.noarch.r 8.3 MB/s | 145 kB 00:00 2020-11-20T12:11:25.727 INFO:teuthology.orchestra.run.smithi134.stdout:(106/137): python3-cssselect-0.9.2-10.el8.noarc 2.4 MB/s | 40 kB 00:00 2020-11-20T12:11:25.730 INFO:teuthology.orchestra.run.smithi134.stdout:(107/137): python3-cherrypy-18.4.0-1.el8.noarch 11 MB/s | 384 kB 00:00 2020-11-20T12:11:25.747 INFO:teuthology.orchestra.run.smithi134.stdout:(108/137): python3-google-auth-1.1.1-10.el8.noa 4.7 MB/s | 81 kB 00:00 2020-11-20T12:11:25.763 INFO:teuthology.orchestra.run.smithi134.stdout:(109/137): python3-execnet-1.7.1-1.el8.noarch.r 10 MB/s | 355 kB 00:00 2020-11-20T12:11:25.763 INFO:teuthology.orchestra.run.smithi134.stdout:(110/137): python3-jaraco-6.2-6.el8.noarch.rpm 677 kB/s | 11 kB 00:00 2020-11-20T12:11:25.777 INFO:teuthology.orchestra.run.smithi134.stdout:(111/137): python3-jaraco-functools-2.0-4.el8.n 1.0 MB/s | 18 kB 00:00 2020-11-20T12:11:25.794 INFO:teuthology.orchestra.run.smithi134.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 2.9 MB/s | 49 kB 00:00 2020-11-20T12:11:25.811 INFO:teuthology.orchestra.run.smithi134.stdout:(113/137): python3-more-itertools-7.2.0-3.el8.n 3.4 MB/s | 59 kB 00:00 2020-11-20T12:11:25.843 INFO:teuthology.orchestra.run.smithi134.stdout:(114/137): python3-pecan-1.3.2-9.el8.noarch.rpm 8.5 MB/s | 283 kB 00:00 2020-11-20T12:11:25.847 INFO:teuthology.orchestra.run.smithi134.stdout:(115/137): python3-kubernetes-11.0.0-2.el8.noar 14 MB/s | 1.2 MB 00:00 2020-11-20T12:11:25.860 INFO:teuthology.orchestra.run.smithi134.stdout:(116/137): python3-portend-2.6-1.el8.noarch.rpm 940 kB/s | 16 kB 00:00 2020-11-20T12:11:25.863 INFO:teuthology.orchestra.run.smithi134.stdout:(117/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.8 MB/s | 48 kB 00:00 2020-11-20T12:11:25.879 INFO:teuthology.orchestra.run.smithi134.stdout:(118/137): python3-repoze-lru-0.7-6.el8.noarch. 2.0 MB/s | 34 kB 00:00 2020-11-20T12:11:25.886 INFO:teuthology.orchestra.run.smithi134.stdout:(119/137): python3-routes-2.4.1-12.el8.noarch.r 11 MB/s | 196 kB 00:00 2020-11-20T12:11:25.894 INFO:teuthology.orchestra.run.smithi134.stdout:(120/137): python3-rsa-3.4.2-15.el8.noarch.rpm 4.1 MB/s | 73 kB 00:00 2020-11-20T12:11:25.900 INFO:teuthology.orchestra.run.smithi134.stdout:(121/137): python3-simplegeneric-0.8.1-17.el8.n 1.1 MB/s | 19 kB 00:00 2020-11-20T12:11:25.911 INFO:teuthology.orchestra.run.smithi134.stdout:(122/137): python3-singledispatch-3.4.0.3-18.el 1.4 MB/s | 24 kB 00:00 2020-11-20T12:11:25.914 INFO:teuthology.orchestra.run.smithi134.stdout:(123/137): python3-tempora-1.14.1-5.el8.noarch. 1.7 MB/s | 29 kB 00:00 2020-11-20T12:11:25.928 INFO:teuthology.orchestra.run.smithi134.stdout:(124/137): python3-trustme-0.6.0-4.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2020-11-20T12:11:25.932 INFO:teuthology.orchestra.run.smithi134.stdout:(125/137): python3-waitress-1.2.1-2.el8.1.noarc 13 MB/s | 241 kB 00:00 2020-11-20T12:11:25.946 INFO:teuthology.orchestra.run.smithi134.stdout:(126/137): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-11-20T12:11:25.949 INFO:teuthology.orchestra.run.smithi134.stdout:(127/137): python3-websocket-client-0.56.0-5.el 3.6 MB/s | 61 kB 00:00 2020-11-20T12:11:25.963 INFO:teuthology.orchestra.run.smithi134.stdout:(128/137): python3-webtest-2.0.33-1.el8.noarch. 4.8 MB/s | 85 kB 00:00 2020-11-20T12:11:25.966 INFO:teuthology.orchestra.run.smithi134.stdout:(129/137): python3-zc-lockfile-2.0-2.el8.noarch 1.4 MB/s | 23 kB 00:00 2020-11-20T12:11:25.980 INFO:teuthology.orchestra.run.smithi134.stdout:(130/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.0 MB/s | 69 kB 00:00 2020-11-20T12:11:26.768 INFO:teuthology.orchestra.run.smithi134.stdout:(131/137): librados2-16.0.0-7397.gb86e691b.el8. 4.6 MB/s | 3.7 MB 00:00 2020-11-20T12:11:26.794 INFO:teuthology.orchestra.run.smithi134.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 83 MB/s | 2.1 MB 00:00 2020-11-20T12:11:26.815 INFO:teuthology.orchestra.run.smithi134.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 83 MB/s | 1.7 MB 00:00 2020-11-20T12:11:26.819 INFO:teuthology.orchestra.run.smithi134.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 55 MB/s | 133 kB 00:00 2020-11-20T12:11:26.822 INFO:teuthology.orchestra.run.smithi134.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 73 MB/s | 308 kB 00:00 2020-11-20T12:11:26.911 INFO:teuthology.orchestra.run.smithi160.stdout:(15/137): ceph-common-16.0.0-7397.gb86e691b.el8 3.3 MB/s | 23 MB 00:06 2020-11-20T12:11:26.934 INFO:teuthology.orchestra.run.smithi134.stdout:(136/137): librbd1-16.0.0-7397.gb86e691b.el8.x8 2.5 MB/s | 2.4 MB 00:00 2020-11-20T12:11:26.968 INFO:teuthology.orchestra.run.smithi160.stdout:(16/137): libcephfs-devel-16.0.0-7397.gb86e691b 423 kB/s | 24 kB 00:00 2020-11-20T12:11:27.140 INFO:teuthology.orchestra.run.smithi160.stdout:(17/137): libcephfs2-16.0.0-7397.gb86e691b.el8. 3.2 MB/s | 562 kB 00:00 2020-11-20T12:11:27.198 INFO:teuthology.orchestra.run.smithi160.stdout:(18/137): librados-devel-16.0.0-7397.gb86e691b. 2.3 MB/s | 131 kB 00:00 2020-11-20T12:11:27.319 INFO:teuthology.orchestra.run.smithi160.stdout:(19/137): libradosstriper1-16.0.0-7397.gb86e691 3.9 MB/s | 486 kB 00:00 2020-11-20T12:11:27.885 INFO:teuthology.orchestra.run.smithi150.stdout:(13/137): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.5 MB/s | 18 MB 00:07 2020-11-20T12:11:27.940 INFO:teuthology.orchestra.run.smithi150.stdout:(14/137): ceph-selinux-16.0.0-7397.gb86e691b.el 452 kB/s | 25 kB 00:00 2020-11-20T12:11:28.216 INFO:teuthology.orchestra.run.smithi160.stdout:(20/137): ceph-radosgw-16.0.0-7397.gb86e691b.el 2.1 MB/s | 12 MB 00:05 2020-11-20T12:11:28.232 INFO:teuthology.orchestra.run.smithi160.stdout:(21/137): librgw2-16.0.0-7397.gb86e691b.el8.x86 4.1 MB/s | 3.7 MB 00:00 2020-11-20T12:11:28.266 INFO:teuthology.orchestra.run.smithi160.stdout:(22/137): python3-ceph-argparse-16.0.0-7397.gb8 835 kB/s | 40 kB 00:00 2020-11-20T12:11:28.283 INFO:teuthology.orchestra.run.smithi160.stdout:(23/137): python3-ceph-common-16.0.0-7397.gb86e 1.4 MB/s | 73 kB 00:00 2020-11-20T12:11:28.374 INFO:teuthology.orchestra.run.smithi160.stdout:(24/137): python3-cephfs-16.0.0-7397.gb86e691b. 1.8 MB/s | 204 kB 00:00 2020-11-20T12:11:28.378 INFO:teuthology.orchestra.run.smithi150.stdout:(15/137): ceph-radosgw-16.0.0-7397.gb86e691b.el 2.2 MB/s | 12 MB 00:05 2020-11-20T12:11:28.394 INFO:teuthology.orchestra.run.smithi160.stdout:(25/137): python3-rados-16.0.0-7397.gb86e691b.e 3.3 MB/s | 375 kB 00:00 2020-11-20T12:11:28.429 INFO:teuthology.orchestra.run.smithi150.stdout:(16/137): libcephfs-devel-16.0.0-7397.gb86e691b 469 kB/s | 24 kB 00:00 2020-11-20T12:11:28.447 INFO:teuthology.orchestra.run.smithi160.stdout:(26/137): python3-rgw-16.0.0-7397.gb86e691b.el8 2.1 MB/s | 113 kB 00:00 2020-11-20T12:11:28.505 INFO:teuthology.orchestra.run.smithi160.stdout:(27/137): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.5 MB/s | 88 kB 00:00 2020-11-20T12:11:28.529 INFO:teuthology.orchestra.run.smithi160.stdout:(28/137): python3-rbd-16.0.0-7397.gb86e691b.el8 2.2 MB/s | 353 kB 00:00 2020-11-20T12:11:28.593 INFO:teuthology.orchestra.run.smithi160.stdout:(29/137): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 2.6 MB/s | 171 kB 00:00 2020-11-20T12:11:28.646 INFO:teuthology.orchestra.run.smithi150.stdout:(17/137): libcephfs2-16.0.0-7397.gb86e691b.el8. 2.5 MB/s | 562 kB 00:00 2020-11-20T12:11:28.646 INFO:teuthology.orchestra.run.smithi160.stdout:(30/137): ceph-grafana-dashboards-16.0.0-7397.g 454 kB/s | 24 kB 00:00 2020-11-20T12:11:28.700 INFO:teuthology.orchestra.run.smithi160.stdout:(31/137): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.2 MB/s | 66 kB 00:00 2020-11-20T12:11:28.811 INFO:teuthology.orchestra.run.smithi150.stdout:(18/137): ceph-common-16.0.0-7397.gb86e691b.el8 2.1 MB/s | 23 MB 00:11 2020-11-20T12:11:28.812 INFO:teuthology.orchestra.run.smithi150.stdout:(19/137): librados-devel-16.0.0-7397.gb86e691b. 786 kB/s | 131 kB 00:00 2020-11-20T12:11:29.044 INFO:teuthology.orchestra.run.smithi150.stdout:(20/137): libradosstriper1-16.0.0-7397.gb86e691 2.0 MB/s | 486 kB 00:00 2020-11-20T12:11:29.101 INFO:teuthology.orchestra.run.smithi150.stdout:(21/137): python3-ceph-argparse-16.0.0-7397.gb8 694 kB/s | 40 kB 00:00 2020-11-20T12:11:29.160 INFO:teuthology.orchestra.run.smithi150.stdout:(22/137): python3-ceph-common-16.0.0-7397.gb86e 1.2 MB/s | 73 kB 00:00 2020-11-20T12:11:29.232 INFO:teuthology.orchestra.run.smithi160.stdout:(32/137): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.4 MB/s | 3.2 MB 00:00 2020-11-20T12:11:29.265 INFO:teuthology.orchestra.run.smithi150.stdout:(23/137): python3-cephfs-16.0.0-7397.gb86e691b. 1.9 MB/s | 204 kB 00:00 2020-11-20T12:11:29.447 INFO:teuthology.orchestra.run.smithi150.stdout:(24/137): python3-rados-16.0.0-7397.gb86e691b.e 2.0 MB/s | 375 kB 00:00 2020-11-20T12:11:29.629 INFO:teuthology.orchestra.run.smithi150.stdout:(25/137): python3-rbd-16.0.0-7397.gb86e691b.el8 1.9 MB/s | 353 kB 00:00 2020-11-20T12:11:29.690 INFO:teuthology.orchestra.run.smithi150.stdout:(26/137): python3-rgw-16.0.0-7397.gb86e691b.el8 1.8 MB/s | 113 kB 00:00 2020-11-20T12:11:29.751 INFO:teuthology.orchestra.run.smithi150.stdout:(27/137): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.4 MB/s | 88 kB 00:00 2020-11-20T12:11:29.848 INFO:teuthology.orchestra.run.smithi160.stdout:(33/137): ceph-mgr-dashboard-16.0.0-7397.gb86e6 2.9 MB/s | 3.2 MB 00:01 2020-11-20T12:11:29.933 INFO:teuthology.orchestra.run.smithi160.stdout:(34/137): ceph-mgr-modules-core-16.0.0-7397.gb8 1.6 MB/s | 198 kB 00:00 2020-11-20T12:11:29.992 INFO:teuthology.orchestra.run.smithi160.stdout:(35/137): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 464 kB/s | 27 kB 00:00 2020-11-20T12:11:30.051 INFO:teuthology.orchestra.run.smithi160.stdout:(36/137): ceph-prometheus-alerts-16.0.0-7397.gb 152 kB/s | 8.8 kB 00:00 2020-11-20T12:11:30.086 INFO:teuthology.orchestra.run.smithi150.stdout:(28/137): librgw2-16.0.0-7397.gb86e691b.el8.x86 2.9 MB/s | 3.7 MB 00:01 2020-11-20T12:11:30.108 INFO:teuthology.orchestra.run.smithi160.stdout:(37/137): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.0 MB/s | 57 kB 00:00 2020-11-20T12:11:30.138 INFO:teuthology.orchestra.run.smithi150.stdout:(29/137): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 3.2 MB/s | 171 kB 00:00 2020-11-20T12:11:30.172 INFO:teuthology.orchestra.run.smithi160.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 11 MB/s | 713 kB 00:00 2020-11-20T12:11:30.180 INFO:teuthology.orchestra.run.smithi150.stdout:(30/137): ceph-grafana-dashboards-16.0.0-7397.g 574 kB/s | 24 kB 00:00 2020-11-20T12:11:30.189 INFO:teuthology.orchestra.run.smithi160.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 38 MB/s | 688 kB 00:00 2020-11-20T12:11:30.197 INFO:teuthology.orchestra.run.smithi160.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 38 MB/s | 320 kB 00:00 2020-11-20T12:11:30.202 INFO:teuthology.orchestra.run.smithi160.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 42 MB/s | 161 kB 00:00 2020-11-20T12:11:30.209 INFO:teuthology.orchestra.run.smithi160.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 49 MB/s | 353 kB 00:00 2020-11-20T12:11:30.223 INFO:teuthology.orchestra.run.smithi160.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 55 MB/s | 709 kB 00:00 2020-11-20T12:11:30.224 INFO:teuthology.orchestra.run.smithi150.stdout:(31/137): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.5 MB/s | 66 kB 00:00 2020-11-20T12:11:30.228 INFO:teuthology.orchestra.run.smithi160.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 48 MB/s | 259 kB 00:00 2020-11-20T12:11:30.233 INFO:teuthology.orchestra.run.smithi160.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 42 MB/s | 188 kB 00:00 2020-11-20T12:11:30.448 INFO:teuthology.orchestra.run.smithi134.stdout:(137/137): ceph-test-16.0.0-7397.gb86e691b.el8. 4.8 MB/s | 48 MB 00:09 2020-11-20T12:11:30.449 INFO:teuthology.orchestra.run.smithi160.stdout:(46/137): ceph-test-16.0.0-7397.gb86e691b.el8.x 9.4 MB/s | 48 MB 00:05 2020-11-20T12:11:30.452 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2020-11-20T12:11:30.453 INFO:teuthology.orchestra.run.smithi134.stdout:Total 16 MB/s | 202 MB 00:12 2020-11-20T12:11:30.476 INFO:teuthology.orchestra.run.smithi160.stdout:(47/137): openblas-0.3.3-2.el8.x86_64.rpm 18 MB/s | 4.3 MB 00:00 2020-11-20T12:11:30.504 INFO:teuthology.orchestra.run.smithi150.stdout:(32/137): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.2 MB/s | 3.2 MB 00:00 2020-11-20T12:11:30.522 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2020-11-20T12:11:30.552 INFO:teuthology.orchestra.run.smithi160.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 64 MB/s | 4.8 MB 00:00 2020-11-20T12:11:30.559 INFO:teuthology.orchestra.run.smithi160.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 34 MB/s | 214 kB 00:00 2020-11-20T12:11:30.573 INFO:teuthology.orchestra.run.smithi160.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 50 MB/s | 538 kB 00:00 2020-11-20T12:11:30.574 INFO:teuthology.orchestra.run.smithi160.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 13 MB/s | 27 kB 00:00 2020-11-20T12:11:30.574 INFO:teuthology.orchestra.run.smithi160.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 9.3 MB/s | 20 kB 00:00 2020-11-20T12:11:30.603 INFO:teuthology.orchestra.run.smithi160.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 54 MB/s | 1.5 MB 00:00 2020-11-20T12:11:30.609 INFO:teuthology.orchestra.run.smithi160.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 28 MB/s | 157 kB 00:00 2020-11-20T12:11:30.611 INFO:teuthology.orchestra.run.smithi160.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 21 MB/s | 39 kB 00:00 2020-11-20T12:11:30.628 INFO:teuthology.orchestra.run.smithi160.stdout:(56/137): openblas-threads-0.3.3-2.el8.x86_64.r 24 MB/s | 4.4 MB 00:00 2020-11-20T12:11:30.637 INFO:teuthology.orchestra.run.smithi160.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 25 MB/s | 225 kB 00:00 2020-11-20T12:11:30.642 INFO:teuthology.orchestra.run.smithi160.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 11 MB/s | 44 kB 00:00 2020-11-20T12:11:30.648 INFO:teuthology.orchestra.run.smithi160.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 18 MB/s | 126 kB 00:00 2020-11-20T12:11:30.653 INFO:teuthology.orchestra.run.smithi160.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 24 MB/s | 110 kB 00:00 2020-11-20T12:11:30.657 INFO:teuthology.orchestra.run.smithi160.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 15 MB/s | 54 kB 00:00 2020-11-20T12:11:30.690 INFO:teuthology.orchestra.run.smithi150.stdout:(33/137): ceph-mgr-dashboard-16.0.0-7397.gb86e6 6.8 MB/s | 3.2 MB 00:00 2020-11-20T12:11:30.692 INFO:teuthology.orchestra.run.smithi160.stdout:(62/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 46 MB/s | 3.7 MB 00:00 2020-11-20T12:11:30.695 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2020-11-20T12:11:30.695 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2020-11-20T12:11:30.696 INFO:teuthology.orchestra.run.smithi160.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 8.3 MB/s | 27 kB 00:00 2020-11-20T12:11:30.707 INFO:teuthology.orchestra.run.smithi160.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 45 MB/s | 457 kB 00:00 2020-11-20T12:11:30.714 INFO:teuthology.orchestra.run.smithi160.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 38 MB/s | 298 kB 00:00 2020-11-20T12:11:30.717 INFO:teuthology.orchestra.run.smithi160.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 21 MB/s | 54 kB 00:00 2020-11-20T12:11:30.721 INFO:teuthology.orchestra.run.smithi160.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 26 MB/s | 82 kB 00:00 2020-11-20T12:11:30.723 INFO:teuthology.orchestra.run.smithi160.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 11 MB/s | 21 kB 00:00 2020-11-20T12:11:30.725 INFO:teuthology.orchestra.run.smithi160.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 23 MB/s | 48 kB 00:00 2020-11-20T12:11:30.737 INFO:teuthology.orchestra.run.smithi160.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 47 MB/s | 548 kB 00:00 2020-11-20T12:11:30.742 INFO:teuthology.orchestra.run.smithi150.stdout:(34/137): ceph-mgr-modules-core-16.0.0-7397.gb8 3.9 MB/s | 198 kB 00:00 2020-11-20T12:11:30.742 INFO:teuthology.orchestra.run.smithi160.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 9.3 MB/s | 19 kB 00:00 2020-11-20T12:11:30.743 INFO:teuthology.orchestra.run.smithi160.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 15 MB/s | 38 kB 00:00 2020-11-20T12:11:30.764 INFO:teuthology.orchestra.run.smithi150.stdout:(35/137): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 1.1 MB/s | 27 kB 00:00 2020-11-20T12:11:30.776 INFO:teuthology.orchestra.run.smithi160.stdout:(73/137): ceph-mgr-diskprediction-local-16.0.0- 5.6 MB/s | 8.6 MB 00:01 2020-11-20T12:11:30.787 INFO:teuthology.orchestra.run.smithi150.stdout:(36/137): ceph-prometheus-alerts-16.0.0-7397.gb 385 kB/s | 8.8 kB 00:00 2020-11-20T12:11:30.792 INFO:teuthology.orchestra.run.smithi160.stdout:(74/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 13 MB/s | 638 kB 00:00 2020-11-20T12:11:30.794 INFO:teuthology.orchestra.run.smithi160.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 21 MB/s | 47 kB 00:00 2020-11-20T12:11:30.801 INFO:teuthology.orchestra.run.smithi160.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 39 MB/s | 199 kB 00:00 2020-11-20T12:11:30.803 INFO:teuthology.orchestra.run.smithi160.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 29 MB/s | 86 kB 00:00 2020-11-20T12:11:30.807 INFO:teuthology.orchestra.run.smithi160.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 26 MB/s | 95 kB 00:00 2020-11-20T12:11:30.809 INFO:teuthology.orchestra.run.smithi160.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 7.7 MB/s | 18 kB 00:00 2020-11-20T12:11:30.811 INFO:teuthology.orchestra.run.smithi150.stdout:(37/137): cephadm-16.0.0-7397.gb86e691b.el8.noa 2.4 MB/s | 57 kB 00:00 2020-11-20T12:11:30.812 INFO:teuthology.orchestra.run.smithi160.stdout:(80/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 4.6 MB/s | 169 kB 00:00 2020-11-20T12:11:30.817 INFO:teuthology.orchestra.run.smithi160.stdout:(81/137): libxslt-1.1.32-3.el8.x86_64.rpm 32 MB/s | 249 kB 00:00 2020-11-20T12:11:30.831 INFO:teuthology.orchestra.run.smithi160.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 45 MB/s | 605 kB 00:00 2020-11-20T12:11:30.838 INFO:teuthology.orchestra.run.smithi160.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 32 MB/s | 228 kB 00:00 2020-11-20T12:11:30.844 INFO:teuthology.orchestra.run.smithi160.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 36 MB/s | 220 kB 00:00 2020-11-20T12:11:30.851 INFO:teuthology.orchestra.run.smithi160.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 32 MB/s | 195 kB 00:00 2020-11-20T12:11:30.855 INFO:teuthology.orchestra.run.smithi160.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 13 MB/s | 43 kB 00:00 2020-11-20T12:11:30.860 INFO:teuthology.orchestra.run.smithi160.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 29 MB/s | 155 kB 00:00 2020-11-20T12:11:30.864 INFO:teuthology.orchestra.run.smithi160.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 11 MB/s | 34 kB 00:00 2020-11-20T12:11:30.870 INFO:teuthology.orchestra.run.smithi160.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 22 MB/s | 123 kB 00:00 2020-11-20T12:11:30.874 INFO:teuthology.orchestra.run.smithi160.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 11 MB/s | 43 kB 00:00 2020-11-20T12:11:30.881 INFO:teuthology.orchestra.run.smithi160.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 26 MB/s | 176 kB 00:00 2020-11-20T12:11:30.887 INFO:teuthology.orchestra.run.smithi160.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 13 MB/s | 69 kB 00:00 2020-11-20T12:11:30.891 INFO:teuthology.orchestra.run.smithi160.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 12 MB/s | 56 kB 00:00 2020-11-20T12:11:30.909 INFO:teuthology.orchestra.run.smithi150.stdout:(38/137): automake-1.16.1-6.el8.noarch.rpm 7.2 MB/s | 713 kB 00:00 2020-11-20T12:11:30.920 INFO:teuthology.orchestra.run.smithi160.stdout:(94/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 21 MB/s | 2.3 MB 00:00 2020-11-20T12:11:30.927 INFO:teuthology.orchestra.run.smithi150.stdout:(39/137): bison-3.0.4-10.el8.x86_64.rpm 40 MB/s | 688 kB 00:00 2020-11-20T12:11:30.939 INFO:teuthology.orchestra.run.smithi150.stdout:(40/137): flex-2.6.1-9.el8.x86_64.rpm 22 MB/s | 320 kB 00:00 2020-11-20T12:11:30.941 INFO:teuthology.orchestra.run.smithi150.stdout:(41/137): jq-1.5-12.el8.x86_64.rpm 61 MB/s | 161 kB 00:00 2020-11-20T12:11:30.946 INFO:teuthology.orchestra.run.smithi150.stdout:(42/137): librdkafka-0.11.4-1.el8.x86_64.rpm 74 MB/s | 353 kB 00:00 2020-11-20T12:11:30.955 INFO:teuthology.orchestra.run.smithi150.stdout:(43/137): libtool-2.4.6-25.el8.x86_64.rpm 80 MB/s | 709 kB 00:00 2020-11-20T12:11:30.959 INFO:teuthology.orchestra.run.smithi150.stdout:(44/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 67 MB/s | 259 kB 00:00 2020-11-20T12:11:30.962 INFO:teuthology.orchestra.run.smithi150.stdout:(45/137): oniguruma-6.8.2-1.el8.x86_64.rpm 65 MB/s | 188 kB 00:00 2020-11-20T12:11:30.991 INFO:teuthology.orchestra.run.smithi160.stdout:(95/137): python3-scipy-1.0.0-20.module_el8.1.0 44 MB/s | 15 MB 00:00 2020-11-20T12:11:31.011 INFO:teuthology.orchestra.run.smithi160.stdout:(96/137): fmt-6.2.1-1.el8.x86_64.rpm 978 kB/s | 116 kB 00:00 2020-11-20T12:11:31.018 INFO:teuthology.orchestra.run.smithi150.stdout:(46/137): openblas-0.3.3-2.el8.x86_64.rpm 86 MB/s | 4.3 MB 00:00 2020-11-20T12:11:31.032 INFO:teuthology.orchestra.run.smithi160.stdout:(97/137): liboath-2.6.2-3.el8.x86_64.rpm 2.8 MB/s | 59 kB 00:00 2020-11-20T12:11:31.040 INFO:teuthology.orchestra.run.smithi160.stdout:(98/137): gperftools-libs-2.7-6.el8.x86_64.rpm 2.6 MB/s | 315 kB 00:00 2020-11-20T12:11:31.052 INFO:teuthology.orchestra.run.smithi160.stdout:(99/137): libunwind-1.3.1-3.el8.x86_64.rpm 3.5 MB/s | 75 kB 00:00 2020-11-20T12:11:31.056 INFO:teuthology.orchestra.run.smithi160.stdout:(100/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-11-20T12:11:31.064 INFO:teuthology.orchestra.run.smithi150.stdout:(47/137): openblas-threads-0.3.3-2.el8.x86_64.r 86 MB/s | 4.4 MB 00:00 2020-11-20T12:11:31.074 INFO:teuthology.orchestra.run.smithi160.stdout:(101/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.0 MB/s | 44 kB 00:00 2020-11-20T12:11:31.077 INFO:teuthology.orchestra.run.smithi160.stdout:(102/137): python3-beautifulsoup4-4.6.3-2.el8.1 8.7 MB/s | 185 kB 00:00 2020-11-20T12:11:31.088 INFO:teuthology.orchestra.run.smithi160.stdout:(103/137): leveldb-1.22-1.el8.x86_64.rpm 1.8 MB/s | 181 kB 00:00 2020-11-20T12:11:31.094 INFO:teuthology.orchestra.run.smithi160.stdout:(104/137): python3-certifi-2018.10.15-7.el8.noa 949 kB/s | 16 kB 00:00 2020-11-20T12:11:31.095 INFO:teuthology.orchestra.run.smithi160.stdout:(105/137): python3-cachetools-3.1.1-4.el8.noarc 1.5 MB/s | 33 kB 00:00 2020-11-20T12:11:31.108 INFO:teuthology.orchestra.run.smithi160.stdout:(106/137): python3-cheroot-8.2.1-1.el8.noarch.r 7.2 MB/s | 145 kB 00:00 2020-11-20T12:11:31.113 INFO:teuthology.orchestra.run.smithi160.stdout:(107/137): python3-cssselect-0.9.2-10.el8.noarc 2.2 MB/s | 40 kB 00:00 2020-11-20T12:11:31.120 INFO:teuthology.orchestra.run.smithi150.stdout:(48/137): python3-babel-2.5.1-5.el8.noarch.rpm 86 MB/s | 4.8 MB 00:00 2020-11-20T12:11:31.125 INFO:teuthology.orchestra.run.smithi150.stdout:(49/137): python3-html5lib-0.999999999-6.el8.no 64 MB/s | 214 kB 00:00 2020-11-20T12:11:31.131 INFO:teuthology.orchestra.run.smithi150.stdout:(50/137): python3-jinja2-2.10.1-2.el8_0.noarch. 79 MB/s | 538 kB 00:00 2020-11-20T12:11:31.132 INFO:teuthology.orchestra.run.smithi150.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 25 MB/s | 27 kB 00:00 2020-11-20T12:11:31.133 INFO:teuthology.orchestra.run.smithi160.stdout:(108/137): python3-google-auth-1.1.1-10.el8.noa 4.2 MB/s | 81 kB 00:00 2020-11-20T12:11:31.134 INFO:teuthology.orchestra.run.smithi150.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 19 MB/s | 20 kB 00:00 2020-11-20T12:11:31.142 INFO:teuthology.orchestra.run.smithi160.stdout:(109/137): python3-cherrypy-18.4.0-1.el8.noarch 8.1 MB/s | 384 kB 00:00 2020-11-20T12:11:31.147 INFO:teuthology.orchestra.run.smithi160.stdout:(110/137): python3-execnet-1.7.1-1.el8.noarch.r 9.0 MB/s | 355 kB 00:00 2020-11-20T12:11:31.151 INFO:teuthology.orchestra.run.smithi150.stdout:(53/137): python3-lxml-4.2.3-1.el8.x86_64.rpm 84 MB/s | 1.5 MB 00:00 2020-11-20T12:11:31.152 INFO:teuthology.orchestra.run.smithi160.stdout:(111/137): python3-jaraco-6.2-6.el8.noarch.rpm 659 kB/s | 11 kB 00:00 2020-11-20T12:11:31.153 INFO:teuthology.orchestra.run.smithi150.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 62 MB/s | 157 kB 00:00 2020-11-20T12:11:31.155 INFO:teuthology.orchestra.run.smithi150.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 31 MB/s | 39 kB 00:00 2020-11-20T12:11:31.162 INFO:teuthology.orchestra.run.smithi160.stdout:(112/137): python3-jaraco-functools-2.0-4.el8.n 863 kB/s | 18 kB 00:00 2020-11-20T12:11:31.169 INFO:teuthology.orchestra.run.smithi160.stdout:(113/137): python3-logutils-0.3.5-11.el8.noarch 2.6 MB/s | 49 kB 00:00 2020-11-20T12:11:31.186 INFO:teuthology.orchestra.run.smithi160.stdout:(114/137): python3-more-itertools-7.2.0-3.el8.n 2.6 MB/s | 59 kB 00:00 2020-11-20T12:11:31.199 INFO:teuthology.orchestra.run.smithi150.stdout:(56/137): python3-numpy-1.14.3-9.el8.x86_64.rpm 86 MB/s | 3.7 MB 00:00 2020-11-20T12:11:31.202 INFO:teuthology.orchestra.run.smithi150.stdout:(57/137): python3-numpy-f2py-1.14.3-9.el8.x86_6 65 MB/s | 225 kB 00:00 2020-11-20T12:11:31.203 INFO:teuthology.orchestra.run.smithi150.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 36 MB/s | 44 kB 00:00 2020-11-20T12:11:31.205 INFO:teuthology.orchestra.run.smithi160.stdout:(115/137): python3-pecan-1.3.2-9.el8.noarch.rpm 7.8 MB/s | 283 kB 00:00 2020-11-20T12:11:31.206 INFO:teuthology.orchestra.run.smithi150.stdout:(59/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 61 MB/s | 126 kB 00:00 2020-11-20T12:11:31.207 INFO:teuthology.orchestra.run.smithi160.stdout:(116/137): python3-portend-2.6-1.el8.noarch.rpm 756 kB/s | 16 kB 00:00 2020-11-20T12:11:31.207 INFO:teuthology.orchestra.run.smithi150.stdout:(60/137): python3-pyasn1-modules-0.3.7-6.el8.no 57 MB/s | 110 kB 00:00 2020-11-20T12:11:31.209 INFO:teuthology.orchestra.run.smithi150.stdout:(61/137): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2020-11-20T12:11:31.224 INFO:teuthology.orchestra.run.smithi160.stdout:(117/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.6 MB/s | 48 kB 00:00 2020-11-20T12:11:31.229 INFO:teuthology.orchestra.run.smithi160.stdout:(118/137): python3-repoze-lru-0.7-6.el8.noarch. 1.5 MB/s | 34 kB 00:00 2020-11-20T12:11:31.243 INFO:teuthology.orchestra.run.smithi160.stdout:(119/137): python3-kubernetes-11.0.0-2.el8.noar 12 MB/s | 1.2 MB 00:00 2020-11-20T12:11:31.249 INFO:teuthology.orchestra.run.smithi160.stdout:(120/137): python3-routes-2.4.1-12.el8.noarch.r 8.0 MB/s | 196 kB 00:00 2020-11-20T12:11:31.252 INFO:teuthology.orchestra.run.smithi160.stdout:(121/137): python3-rsa-3.4.2-15.el8.noarch.rpm 3.2 MB/s | 73 kB 00:00 2020-11-20T12:11:31.261 INFO:teuthology.orchestra.run.smithi160.stdout:(122/137): python3-simplegeneric-0.8.1-17.el8.n 1.1 MB/s | 19 kB 00:00 2020-11-20T12:11:31.266 INFO:teuthology.orchestra.run.smithi160.stdout:(123/137): python3-singledispatch-3.4.0.3-18.el 1.4 MB/s | 24 kB 00:00 2020-11-20T12:11:31.273 INFO:teuthology.orchestra.run.smithi160.stdout:(124/137): python3-tempora-1.14.1-5.el8.noarch. 1.4 MB/s | 29 kB 00:00 2020-11-20T12:11:31.278 INFO:teuthology.orchestra.run.smithi160.stdout:(125/137): python3-trustme-0.6.0-4.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2020-11-20T12:11:31.289 INFO:teuthology.orchestra.run.smithi160.stdout:(126/137): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2020-11-20T12:11:31.297 INFO:teuthology.orchestra.run.smithi160.stdout:(127/137): python3-websocket-client-0.56.0-5.el 3.2 MB/s | 61 kB 00:00 2020-11-20T12:11:31.308 INFO:teuthology.orchestra.run.smithi160.stdout:(128/137): python3-webtest-2.0.33-1.el8.noarch. 4.4 MB/s | 85 kB 00:00 2020-11-20T12:11:31.314 INFO:teuthology.orchestra.run.smithi160.stdout:(129/137): python3-webob-1.8.5-1.el8.1.noarch.r 6.0 MB/s | 251 kB 00:00 2020-11-20T12:11:31.316 INFO:teuthology.orchestra.run.smithi160.stdout:(130/137): python3-zc-lockfile-2.0-2.el8.noarch 1.2 MB/s | 23 kB 00:00 2020-11-20T12:11:31.327 INFO:teuthology.orchestra.run.smithi160.stdout:(131/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.6 MB/s | 69 kB 00:00 2020-11-20T12:11:31.395 INFO:teuthology.orchestra.run.smithi160.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 31 MB/s | 2.1 MB 00:00 2020-11-20T12:11:31.424 INFO:teuthology.orchestra.run.smithi160.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 60 MB/s | 1.7 MB 00:00 2020-11-20T12:11:31.428 INFO:teuthology.orchestra.run.smithi160.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 33 MB/s | 133 kB 00:00 2020-11-20T12:11:31.435 INFO:teuthology.orchestra.run.smithi160.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 52 MB/s | 308 kB 00:00 2020-11-20T12:11:31.443 INFO:teuthology.orchestra.run.smithi150.stdout:(62/137): python3-scipy-1.0.0-20.module_el8.1.0 63 MB/s | 15 MB 00:00 2020-11-20T12:11:31.444 INFO:teuthology.orchestra.run.smithi150.stdout:(63/137): python3-webencodings-0.5.1-6.el8.noar 17 MB/s | 27 kB 00:00 2020-11-20T12:11:31.448 INFO:teuthology.orchestra.run.smithi150.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 76 MB/s | 457 kB 00:00 2020-11-20T12:11:31.452 INFO:teuthology.orchestra.run.smithi150.stdout:(65/137): socat-1.7.3.2-6.el8.x86_64.rpm 71 MB/s | 298 kB 00:00 2020-11-20T12:11:31.455 INFO:teuthology.orchestra.run.smithi150.stdout:(66/137): elfutils-libelf-devel-0.176-5.el8.x86 37 MB/s | 54 kB 00:00 2020-11-20T12:11:31.456 INFO:teuthology.orchestra.run.smithi150.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 50 MB/s | 82 kB 00:00 2020-11-20T12:11:31.457 INFO:teuthology.orchestra.run.smithi150.stdout:(68/137): fuse-common-3.2.1-12.el8.x86_64.rpm 21 MB/s | 21 kB 00:00 2020-11-20T12:11:31.459 INFO:teuthology.orchestra.run.smithi150.stdout:(69/137): keyutils-libs-devel-1.5.10-6.el8.x86_ 31 MB/s | 48 kB 00:00 2020-11-20T12:11:31.466 INFO:teuthology.orchestra.run.smithi150.stdout:(70/137): krb5-devel-1.17-9.el8.x86_64.rpm 76 MB/s | 548 kB 00:00 2020-11-20T12:11:31.469 INFO:teuthology.orchestra.run.smithi150.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 18 MB/s | 19 kB 00:00 2020-11-20T12:11:31.470 INFO:teuthology.orchestra.run.smithi150.stdout:(72/137): libcom_err-devel-1.44.6-3.el8.x86_64. 29 MB/s | 38 kB 00:00 2020-11-20T12:11:31.477 INFO:teuthology.orchestra.run.smithi150.stdout:(73/137): libgfortran-8.3.1-4.5.el8.x86_64.rpm 78 MB/s | 638 kB 00:00 2020-11-20T12:11:31.480 INFO:teuthology.orchestra.run.smithi150.stdout:(74/137): libquadmath-8.3.1-4.5.el8.x86_64.rpm 63 MB/s | 169 kB 00:00 2020-11-20T12:11:31.481 INFO:teuthology.orchestra.run.smithi150.stdout:(75/137): librabbitmq-0.9.0-1.el8.x86_64.rpm 37 MB/s | 47 kB 00:00 2020-11-20T12:11:31.484 INFO:teuthology.orchestra.run.smithi150.stdout:(76/137): libselinux-devel-2.9-2.1.el8.x86_64.r 60 MB/s | 199 kB 00:00 2020-11-20T12:11:31.486 INFO:teuthology.orchestra.run.smithi150.stdout:(77/137): libsepol-devel-2.9-1.el8.x86_64.rpm 50 MB/s | 86 kB 00:00 2020-11-20T12:11:31.488 INFO:teuthology.orchestra.run.smithi150.stdout:(78/137): libuuid-devel-2.32.1-17.el8.x86_64.rp 52 MB/s | 95 kB 00:00 2020-11-20T12:11:31.489 INFO:teuthology.orchestra.run.smithi150.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 17 MB/s | 18 kB 00:00 2020-11-20T12:11:31.493 INFO:teuthology.orchestra.run.smithi150.stdout:(80/137): libxslt-1.1.32-3.el8.x86_64.rpm 66 MB/s | 249 kB 00:00 2020-11-20T12:11:31.520 INFO:teuthology.orchestra.run.smithi150.stdout:(81/137): openssl-devel-1.1.1c-2.el8_1.1.x86_64 85 MB/s | 2.3 MB 00:00 2020-11-20T12:11:31.528 INFO:teuthology.orchestra.run.smithi150.stdout:(82/137): pcre2-devel-10.32-1.el8.x86_64.rpm 78 MB/s | 605 kB 00:00 2020-11-20T12:11:31.531 INFO:teuthology.orchestra.run.smithi150.stdout:(83/137): pcre2-utf16-10.32-1.el8.x86_64.rpm 69 MB/s | 228 kB 00:00 2020-11-20T12:11:31.535 INFO:teuthology.orchestra.run.smithi150.stdout:(84/137): pcre2-utf32-10.32-1.el8.x86_64.rpm 68 MB/s | 220 kB 00:00 2020-11-20T12:11:31.538 INFO:teuthology.orchestra.run.smithi150.stdout:(85/137): python3-chardet-3.0.4-7.el8.noarch.rp 65 MB/s | 195 kB 00:00 2020-11-20T12:11:31.539 INFO:teuthology.orchestra.run.smithi150.stdout:(86/137): python3-jwt-1.6.1-2.el8.noarch.rpm 34 MB/s | 43 kB 00:00 2020-11-20T12:11:31.542 INFO:teuthology.orchestra.run.smithi150.stdout:(87/137): python3-oauthlib-2.1.0-1.el8.noarch.r 61 MB/s | 155 kB 00:00 2020-11-20T12:11:31.543 INFO:teuthology.orchestra.run.smithi150.stdout:(88/137): python3-pysocks-1.6.8-3.el8.noarch.rp 28 MB/s | 34 kB 00:00 2020-11-20T12:11:31.545 INFO:teuthology.orchestra.run.smithi150.stdout:(89/137): python3-requests-2.20.0-2.1.el8_1.noa 54 MB/s | 123 kB 00:00 2020-11-20T12:11:31.547 INFO:teuthology.orchestra.run.smithi150.stdout:(90/137): python3-requests-oauthlib-1.0.0-1.el8 35 MB/s | 43 kB 00:00 2020-11-20T12:11:31.550 INFO:teuthology.orchestra.run.smithi150.stdout:(91/137): python3-urllib3-1.24.2-2.el8.noarch.r 61 MB/s | 176 kB 00:00 2020-11-20T12:11:31.552 INFO:teuthology.orchestra.run.smithi150.stdout:(92/137): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 45 MB/s | 69 kB 00:00 2020-11-20T12:11:31.554 INFO:teuthology.orchestra.run.smithi150.stdout:(93/137): zlib-devel-1.2.11-10.el8.x86_64.rpm 30 MB/s | 56 kB 00:00 2020-11-20T12:11:31.594 INFO:teuthology.orchestra.run.smithi160.stdout:(136/137): librbd1-16.0.0-7397.gb86e691b.el8.x8 8.7 MB/s | 2.4 MB 00:00 2020-11-20T12:11:31.654 INFO:teuthology.orchestra.run.smithi150.stdout:(94/137): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T12:11:31.693 INFO:teuthology.orchestra.run.smithi150.stdout:(95/137): gperftools-libs-2.7-6.el8.x86_64.rpm 7.7 MB/s | 315 kB 00:00 2020-11-20T12:11:31.733 INFO:teuthology.orchestra.run.smithi150.stdout:(96/137): ceph-mgr-diskprediction-local-16.0.0- 7.0 MB/s | 8.6 MB 00:01 2020-11-20T12:11:31.734 INFO:teuthology.orchestra.run.smithi150.stdout:(97/137): leveldb-1.22-1.el8.x86_64.rpm 4.2 MB/s | 181 kB 00:00 2020-11-20T12:11:31.755 INFO:teuthology.orchestra.run.smithi150.stdout:(98/137): libunwind-1.3.1-3.el8.x86_64.rpm 3.6 MB/s | 75 kB 00:00 2020-11-20T12:11:31.775 INFO:teuthology.orchestra.run.smithi150.stdout:(99/137): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T12:11:31.796 INFO:teuthology.orchestra.run.smithi150.stdout:(100/137): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.0 MB/s | 44 kB 00:00 2020-11-20T12:11:31.798 INFO:teuthology.orchestra.run.smithi150.stdout:(101/137): liboath-2.6.2-3.el8.x86_64.rpm 909 kB/s | 59 kB 00:00 2020-11-20T12:11:31.815 INFO:teuthology.orchestra.run.smithi150.stdout:(102/137): python3-cachetools-3.1.1-4.el8.noarc 1.9 MB/s | 33 kB 00:00 2020-11-20T12:11:31.816 INFO:teuthology.orchestra.run.smithi150.stdout:(103/137): python3-beautifulsoup4-4.6.3-2.el8.1 8.7 MB/s | 185 kB 00:00 2020-11-20T12:11:31.831 INFO:teuthology.orchestra.run.smithi150.stdout:(104/137): python3-certifi-2018.10.15-7.el8.noa 991 kB/s | 16 kB 00:00 2020-11-20T12:11:31.841 INFO:teuthology.orchestra.run.smithi150.stdout:(105/137): python3-cheroot-8.2.1-1.el8.noarch.r 6.8 MB/s | 145 kB 00:00 2020-11-20T12:11:31.857 INFO:teuthology.orchestra.run.smithi150.stdout:(106/137): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-11-20T12:11:31.881 INFO:teuthology.orchestra.run.smithi150.stdout:(107/137): python3-cherrypy-18.4.0-1.el8.noarch 7.6 MB/s | 384 kB 00:00 2020-11-20T12:11:31.897 INFO:teuthology.orchestra.run.smithi150.stdout:(108/137): python3-execnet-1.7.1-1.el8.noarch.r 8.8 MB/s | 355 kB 00:00 2020-11-20T12:11:31.898 INFO:teuthology.orchestra.run.smithi150.stdout:(109/137): python3-google-auth-1.1.1-10.el8.noa 4.6 MB/s | 81 kB 00:00 2020-11-20T12:11:31.917 INFO:teuthology.orchestra.run.smithi150.stdout:(110/137): python3-jaraco-functools-2.0-4.el8.n 1.0 MB/s | 18 kB 00:00 2020-11-20T12:11:31.917 INFO:teuthology.orchestra.run.smithi150.stdout:(111/137): python3-jaraco-6.2-6.el8.noarch.rpm 568 kB/s | 11 kB 00:00 2020-11-20T12:11:31.937 INFO:teuthology.orchestra.run.smithi150.stdout:(112/137): python3-logutils-0.3.5-11.el8.noarch 2.4 MB/s | 49 kB 00:00 2020-11-20T12:11:31.954 INFO:teuthology.orchestra.run.smithi160.stdout:(137/137): librados2-16.0.0-7397.gb86e691b.el8. 5.8 MB/s | 3.7 MB 00:00 2020-11-20T12:11:31.957 INFO:teuthology.orchestra.run.smithi150.stdout:(113/137): python3-more-itertools-7.2.0-3.el8.n 2.9 MB/s | 59 kB 00:00 2020-11-20T12:11:31.960 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2020-11-20T12:11:31.963 INFO:teuthology.orchestra.run.smithi160.stdout:Total 15 MB/s | 202 MB 00:13 2020-11-20T12:11:31.997 INFO:teuthology.orchestra.run.smithi150.stdout:(114/137): python3-kubernetes-11.0.0-2.el8.noar 14 MB/s | 1.2 MB 00:00 2020-11-20T12:11:31.998 INFO:teuthology.orchestra.run.smithi150.stdout:(115/137): python3-pecan-1.3.2-9.el8.noarch.rpm 6.7 MB/s | 283 kB 00:00 2020-11-20T12:11:32.015 INFO:teuthology.orchestra.run.smithi150.stdout:(116/137): python3-portend-2.6-1.el8.noarch.rpm 942 kB/s | 16 kB 00:00 2020-11-20T12:11:32.019 INFO:teuthology.orchestra.run.smithi150.stdout:(117/137): python3-remoto-1.1.4-4.el8.noarch.rp 2.4 MB/s | 48 kB 00:00 2020-11-20T12:11:32.031 INFO:teuthology.orchestra.run.smithi150.stdout:(118/137): python3-repoze-lru-0.7-6.el8.noarch. 2.0 MB/s | 34 kB 00:00 2020-11-20T12:11:32.039 INFO:teuthology.orchestra.run.smithi150.stdout:(119/137): python3-routes-2.4.1-12.el8.noarch.r 9.2 MB/s | 196 kB 00:00 2020-11-20T12:11:32.048 INFO:teuthology.orchestra.run.smithi150.stdout:(120/137): python3-rsa-3.4.2-15.el8.noarch.rpm 4.2 MB/s | 73 kB 00:00 2020-11-20T12:11:32.059 INFO:teuthology.orchestra.run.smithi150.stdout:(121/137): python3-simplegeneric-0.8.1-17.el8.n 955 kB/s | 19 kB 00:00 2020-11-20T12:11:32.065 INFO:teuthology.orchestra.run.smithi150.stdout:(122/137): python3-singledispatch-3.4.0.3-18.el 1.4 MB/s | 24 kB 00:00 2020-11-20T12:11:32.079 INFO:teuthology.orchestra.run.smithi150.stdout:(123/137): python3-tempora-1.14.1-5.el8.noarch. 1.5 MB/s | 29 kB 00:00 2020-11-20T12:11:32.081 INFO:teuthology.orchestra.run.smithi150.stdout:(124/137): python3-trustme-0.6.0-4.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2020-11-20T12:11:32.087 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2020-11-20T12:11:32.100 INFO:teuthology.orchestra.run.smithi150.stdout:(125/137): python3-webob-1.8.5-1.el8.1.noarch.r 14 MB/s | 251 kB 00:00 2020-11-20T12:11:32.101 INFO:teuthology.orchestra.run.smithi150.stdout:(126/137): python3-waitress-1.2.1-2.el8.1.noarc 11 MB/s | 241 kB 00:00 2020-11-20T12:11:32.116 INFO:teuthology.orchestra.run.smithi150.stdout:(127/137): python3-websocket-client-0.56.0-5.el 3.6 MB/s | 61 kB 00:00 2020-11-20T12:11:32.121 INFO:teuthology.orchestra.run.smithi150.stdout:(128/137): python3-webtest-2.0.33-1.el8.noarch. 4.1 MB/s | 85 kB 00:00 2020-11-20T12:11:32.134 INFO:teuthology.orchestra.run.smithi150.stdout:(129/137): python3-zc-lockfile-2.0-2.el8.noarch 1.3 MB/s | 23 kB 00:00 2020-11-20T12:11:32.141 INFO:teuthology.orchestra.run.smithi150.stdout:(130/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.4 MB/s | 69 kB 00:00 2020-11-20T12:11:32.189 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2020-11-20T12:11:32.190 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2020-11-20T12:11:32.298 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2020-11-20T12:11:32.299 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2020-11-20T12:11:33.153 INFO:teuthology.orchestra.run.smithi150.stdout:(131/137): librbd1-16.0.0-7397.gb86e691b.el8.x8 2.4 MB/s | 2.4 MB 00:01 2020-11-20T12:11:33.179 INFO:teuthology.orchestra.run.smithi150.stdout:(132/137): NetworkManager-1.20.0-5.el8_1.x86_64 84 MB/s | 2.1 MB 00:00 2020-11-20T12:11:33.200 INFO:teuthology.orchestra.run.smithi150.stdout:(133/137): NetworkManager-libnm-1.20.0-5.el8_1. 80 MB/s | 1.7 MB 00:00 2020-11-20T12:11:33.202 INFO:teuthology.orchestra.run.smithi150.stdout:(134/137): NetworkManager-team-1.20.0-5.el8_1.x 58 MB/s | 133 kB 00:00 2020-11-20T12:11:33.207 INFO:teuthology.orchestra.run.smithi150.stdout:(135/137): NetworkManager-tui-1.20.0-5.el8_1.x8 73 MB/s | 308 kB 00:00 2020-11-20T12:11:33.982 INFO:teuthology.orchestra.run.smithi150.stdout:(136/137): librados2-16.0.0-7397.gb86e691b.el8. 2.0 MB/s | 3.7 MB 00:01 2020-11-20T12:11:34.330 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2020-11-20T12:11:34.330 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2020-11-20T12:11:37.459 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2020-11-20T12:11:37.695 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-11-20T12:11:37.943 INFO:teuthology.orchestra.run.smithi134.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T12:11:37.997 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T12:11:38.185 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-11-20T12:11:38.330 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-11-20T12:11:38.570 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-11-20T12:11:38.746 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T12:11:38.821 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T12:11:39.042 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-11-20T12:11:39.230 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T12:11:39.665 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T12:11:39.763 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2020-11-20T12:11:39.854 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T12:11:39.996 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-11-20T12:11:40.146 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T12:11:40.222 INFO:teuthology.orchestra.run.smithi160.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T12:11:40.352 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T12:11:40.471 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T12:11:40.522 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-11-20T12:11:40.565 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T12:11:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T12:11:40.762 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-11-20T12:11:40.829 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T12:11:41.035 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-11-20T12:11:41.186 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T12:11:41.292 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T12:11:41.373 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T12:11:41.445 INFO:teuthology.orchestra.run.smithi150.stdout:(137/137): ceph-test-16.0.0-7397.gb86e691b.el8. 3.5 MB/s | 48 MB 00:13 2020-11-20T12:11:41.449 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2020-11-20T12:11:41.449 INFO:teuthology.orchestra.run.smithi150.stdout:Total 8.5 MB/s | 202 MB 00:23 2020-11-20T12:11:41.520 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2020-11-20T12:11:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:11:41.600 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-11-20T12:11:41.695 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2020-11-20T12:11:41.695 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2020-11-20T12:11:41.739 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:11:41.828 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T12:11:41.992 INFO:teuthology.orchestra.run.smithi134.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-11-20T12:11:43.702 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2020-11-20T12:11:43.703 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2020-11-20T12:11:43.703 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T12:11:43.703 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T12:11:43.704 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T12:11:43.704 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T12:11:43.704 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T12:11:43.704 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T12:11:43.704 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-11-20T12:11:43.705 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-11-20T12:11:43.705 INFO:teuthology.orchestra.run.smithi134.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-11-20T12:11:43.705 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T12:11:43.705 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T12:11:43.706 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T12:11:43.706 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T12:11:43.806 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:43.837 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T12:11:44.071 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:44.168 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:44.458 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T12:11:44.553 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-11-20T12:11:44.651 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:11:44.733 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-11-20T12:11:44.930 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:11:44.954 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-11-20T12:11:45.126 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-11-20T12:11:45.192 INFO:teuthology.orchestra.run.smithi160.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-11-20T12:11:45.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T12:11:45.419 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T12:11:45.480 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-11-20T12:11:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T12:11:45.772 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-11-20T12:11:46.065 INFO:teuthology.orchestra.run.smithi160.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-11-20T12:11:46.131 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T12:11:46.252 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T12:11:46.270 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T12:11:46.844 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T12:11:47.003 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T12:11:47.072 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T12:11:47.394 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T12:11:47.482 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T12:11:47.702 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T12:11:47.917 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:48.064 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-11-20T12:11:48.172 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:48.260 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-11-20T12:11:48.392 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:48.464 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-11-20T12:11:48.660 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-11-20T12:11:48.669 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2020-11-20T12:11:48.678 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-11-20T12:11:48.824 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 32/148 2020-11-20T12:11:48.850 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-11-20T12:11:48.873 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/1 2020-11-20T12:11:48.991 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 33/148 2020-11-20T12:11:49.063 INFO:teuthology.orchestra.run.smithi150.stdout: Downgrading : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T12:11:49.083 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-11-20T12:11:49.138 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 1/148 2020-11-20T12:11:49.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 34/148 2020-11-20T12:11:49.311 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fmt-6.2.1-1.el8.x86_64 2/148 2020-11-20T12:11:49.359 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-11-20T12:11:49.437 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/148 2020-11-20T12:11:49.519 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T12:11:49.645 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : leveldb-1.22-1.el8.x86_64 4/148 2020-11-20T12:11:49.772 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T12:11:49.775 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T12:11:49.943 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T12:11:50.100 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 5/148 2020-11-20T12:11:50.141 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/148 2020-11-20T12:11:50.272 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 6/148 2020-11-20T12:11:50.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 36/148 2020-11-20T12:11:50.513 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T12:11:50.706 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T12:11:50.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 37/148 2020-11-20T12:11:50.869 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T12:11:50.919 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/148 2020-11-20T12:11:50.927 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T12:11:51.112 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T12:11:51.381 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/148 2020-11-20T12:11:51.612 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T12:11:51.629 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T12:11:51.740 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 9/148 2020-11-20T12:11:51.860 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T12:11:51.871 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T12:11:51.970 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 10/148 2020-11-20T12:11:52.466 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T12:11:52.596 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:11:52.802 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:11:52.848 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T12:11:52.874 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T12:11:53.051 INFO:teuthology.orchestra.run.smithi150.stdout: Downgrading : krb5-libs-1.17-9.el8.x86_64 13/148 2020-11-20T12:11:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 39/148 2020-11-20T12:11:53.215 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/148 2020-11-20T12:11:53.230 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-11-20T12:11:53.431 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/148 2020-11-20T12:11:53.473 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 40/148 2020-11-20T12:11:53.481 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-11-20T12:11:53.606 INFO:teuthology.orchestra.run.smithi150.stdout: Downgrading : libkadm5-1.17-9.el8.x86_64 16/148 2020-11-20T12:11:53.691 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-11-20T12:11:53.737 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T12:11:53.747 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 41/148 2020-11-20T12:11:53.952 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-11-20T12:11:54.049 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/148 2020-11-20T12:11:54.093 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 17/148 2020-11-20T12:11:54.145 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 32/148 2020-11-20T12:11:54.263 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 43/148 2020-11-20T12:11:54.326 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 33/148 2020-11-20T12:11:54.354 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T12:11:54.476 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 44/148 2020-11-20T12:11:54.481 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 18/148 2020-11-20T12:11:54.629 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 34/148 2020-11-20T12:11:54.673 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 45/148 2020-11-20T12:11:54.781 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:54.904 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 46/148 2020-11-20T12:11:55.021 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:55.068 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 47/148 2020-11-20T12:11:55.129 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.20.0-5.el8_1.x86_64 19/148 2020-11-20T12:11:55.263 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/148 2020-11-20T12:11:55.351 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/148 2020-11-20T12:11:55.497 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 21/148 2020-11-20T12:11:55.551 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/148 2020-11-20T12:11:55.694 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 22/148 2020-11-20T12:11:55.801 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/148 2020-11-20T12:11:55.851 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 23/148 2020-11-20T12:11:55.852 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/148 2020-11-20T12:11:55.942 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/148 2020-11-20T12:11:55.987 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T12:11:56.113 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 24/148 2020-11-20T12:11:56.131 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/148 2020-11-20T12:11:56.279 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 36/148 2020-11-20T12:11:56.280 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/148 2020-11-20T12:11:56.295 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T12:11:56.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/148 2020-11-20T12:11:56.643 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 37/148 2020-11-20T12:11:56.729 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/148 2020-11-20T12:11:56.839 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 25/148 2020-11-20T12:11:56.877 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T12:11:56.956 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/148 2020-11-20T12:11:56.971 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T12:11:57.091 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/148 2020-11-20T12:11:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/148 2020-11-20T12:11:57.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 59/148 2020-11-20T12:11:57.528 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 26/148 2020-11-20T12:11:57.653 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T12:11:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/148 2020-11-20T12:11:57.930 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/148 2020-11-20T12:11:58.146 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 62/148 2020-11-20T12:11:58.309 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/148 2020-11-20T12:11:58.354 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 27/148 2020-11-20T12:11:58.508 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 64/148 2020-11-20T12:11:58.706 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 28/148 2020-11-20T12:11:58.725 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 65/148 2020-11-20T12:11:58.901 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/148 2020-11-20T12:11:58.920 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 66/148 2020-11-20T12:11:59.058 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 30/148 2020-11-20T12:11:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/148 2020-11-20T12:11:59.218 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 31/148 2020-11-20T12:11:59.383 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 32/148 2020-11-20T12:11:59.389 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T12:11:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 68/148 2020-11-20T12:11:59.516 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 33/148 2020-11-20T12:11:59.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 69/148 2020-11-20T12:11:59.732 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 34/148 2020-11-20T12:11:59.747 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 39/148 2020-11-20T12:11:59.908 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 70/148 2020-11-20T12:12:00.108 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/148 2020-11-20T12:12:00.109 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 40/148 2020-11-20T12:12:00.334 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 72/148 2020-11-20T12:12:00.411 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 41/148 2020-11-20T12:12:00.555 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 73/148 2020-11-20T12:12:00.666 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 35/148 2020-11-20T12:12:00.711 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/148 2020-11-20T12:12:00.784 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 74/148 2020-11-20T12:12:00.958 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 43/148 2020-11-20T12:12:00.972 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 75/148 2020-11-20T12:12:00.993 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 36/148 2020-11-20T12:12:01.172 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 76/148 2020-11-20T12:12:01.242 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 37/148 2020-11-20T12:12:01.246 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 44/148 2020-11-20T12:12:01.469 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T12:12:01.472 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 45/148 2020-11-20T12:12:01.754 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 46/148 2020-11-20T12:12:01.998 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 47/148 2020-11-20T12:12:02.227 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/148 2020-11-20T12:12:02.249 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/148 2020-11-20T12:12:02.495 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 78/148 2020-11-20T12:12:02.566 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/148 2020-11-20T12:12:02.708 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 79/148 2020-11-20T12:12:02.822 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/148 2020-11-20T12:12:03.009 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/148 2020-11-20T12:12:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 80/148 2020-11-20T12:12:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 81/148 2020-11-20T12:12:03.333 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/148 2020-11-20T12:12:03.334 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/148 2020-11-20T12:12:03.357 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 82/148 2020-11-20T12:12:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 38/148 2020-11-20T12:12:03.530 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 83/148 2020-11-20T12:12:03.557 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/148 2020-11-20T12:12:03.755 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 39/148 2020-11-20T12:12:03.804 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/148 2020-11-20T12:12:03.854 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T12:12:03.991 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 40/148 2020-11-20T12:12:04.019 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/148 2020-11-20T12:12:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 85/148 2020-11-20T12:12:04.170 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/148 2020-11-20T12:12:04.206 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 41/148 2020-11-20T12:12:04.263 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 86/148 2020-11-20T12:12:04.413 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/148 2020-11-20T12:12:04.459 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/148 2020-11-20T12:12:04.521 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 87/148 2020-11-20T12:12:04.614 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 43/148 2020-11-20T12:12:04.642 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 59/148 2020-11-20T12:12:04.769 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 88/148 2020-11-20T12:12:04.770 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 89/148 2020-11-20T12:12:04.770 INFO:teuthology.orchestra.run.smithi134.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T12:12:04.770 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:12:04.808 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 44/148 2020-11-20T12:12:04.853 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/148 2020-11-20T12:12:04.965 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 45/148 2020-11-20T12:12:05.154 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-12.el8.x86_64 90/148 2020-11-20T12:12:05.155 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 46/148 2020-11-20T12:12:05.157 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/148 2020-11-20T12:12:05.294 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 47/148 2020-11-20T12:12:05.407 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 62/148 2020-11-20T12:12:05.415 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 91/148 2020-11-20T12:12:05.489 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/148 2020-11-20T12:12:05.619 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/148 2020-11-20T12:12:05.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 92/148 2020-11-20T12:12:05.736 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/148 2020-11-20T12:12:05.811 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 64/148 2020-11-20T12:12:06.002 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/148 2020-11-20T12:12:06.118 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 93/148 2020-11-20T12:12:06.129 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 65/148 2020-11-20T12:12:06.134 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/148 2020-11-20T12:12:06.298 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/148 2020-11-20T12:12:06.378 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 66/148 2020-11-20T12:12:06.426 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 94/148 2020-11-20T12:12:06.438 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/148 2020-11-20T12:12:06.591 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/148 2020-11-20T12:12:06.662 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/148 2020-11-20T12:12:06.734 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/148 2020-11-20T12:12:06.847 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/148 2020-11-20T12:12:06.923 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 68/148 2020-11-20T12:12:07.006 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/148 2020-11-20T12:12:07.058 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/148 2020-11-20T12:12:07.158 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/148 2020-11-20T12:12:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/148 2020-11-20T12:12:07.239 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 69/148 2020-11-20T12:12:07.342 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/148 2020-11-20T12:12:07.443 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 70/148 2020-11-20T12:12:07.531 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 59/148 2020-11-20T12:12:07.725 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/148 2020-11-20T12:12:07.736 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/148 2020-11-20T12:12:07.948 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/148 2020-11-20T12:12:07.977 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 72/148 2020-11-20T12:12:08.146 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 62/148 2020-11-20T12:12:08.255 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 73/148 2020-11-20T12:12:08.351 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 63/148 2020-11-20T12:12:08.518 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 64/148 2020-11-20T12:12:08.589 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 74/148 2020-11-20T12:12:08.710 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 65/148 2020-11-20T12:12:08.896 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 75/148 2020-11-20T12:12:08.921 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 66/148 2020-11-20T12:12:09.092 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/148 2020-11-20T12:12:09.138 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 76/148 2020-11-20T12:12:09.325 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 68/148 2020-11-20T12:12:09.557 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 69/148 2020-11-20T12:12:09.729 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 70/148 2020-11-20T12:12:09.925 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 71/148 2020-11-20T12:12:10.150 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 72/148 2020-11-20T12:12:10.336 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 73/148 2020-11-20T12:12:10.559 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/148 2020-11-20T12:12:10.597 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 74/148 2020-11-20T12:12:10.772 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 75/148 2020-11-20T12:12:10.896 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 78/148 2020-11-20T12:12:10.939 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 76/148 2020-11-20T12:12:11.072 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:11.130 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 79/148 2020-11-20T12:12:11.341 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:11.501 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 80/148 2020-11-20T12:12:11.692 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 81/148 2020-11-20T12:12:11.904 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 82/148 2020-11-20T12:12:12.008 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/148 2020-11-20T12:12:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:12.096 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 83/148 2020-11-20T12:12:12.297 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 78/148 2020-11-20T12:12:12.396 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T12:12:12.479 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T12:12:12.513 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 79/148 2020-11-20T12:12:12.649 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T12:12:12.790 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 80/148 2020-11-20T12:12:12.978 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 81/148 2020-11-20T12:12:13.015 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T12:12:13.141 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 82/148 2020-11-20T12:12:13.264 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 85/148 2020-11-20T12:12:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 83/148 2020-11-20T12:12:13.446 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 86/148 2020-11-20T12:12:13.608 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T12:12:13.733 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 87/148 2020-11-20T12:12:13.797 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 85/148 2020-11-20T12:12:13.930 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 86/148 2020-11-20T12:12:14.006 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 88/148 2020-11-20T12:12:14.007 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 89/148 2020-11-20T12:12:14.007 INFO:teuthology.orchestra.run.smithi160.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T12:12:14.007 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:12:14.174 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 87/148 2020-11-20T12:12:14.378 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 88/148 2020-11-20T12:12:14.379 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 89/148 2020-11-20T12:12:14.379 INFO:teuthology.orchestra.run.smithi150.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T12:12:14.379 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:12:14.440 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.7-12.el8.x86_64 90/148 2020-11-20T12:12:14.751 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 91/148 2020-11-20T12:12:14.787 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.7-12.el8.x86_64 90/148 2020-11-20T12:12:15.849 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 92/148 2020-11-20T12:12:15.849 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 93/148 2020-11-20T12:12:15.850 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 91/148 2020-11-20T12:12:15.850 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 92/148 2020-11-20T12:12:15.850 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 93/148 2020-11-20T12:12:15.862 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 94/148 2020-11-20T12:12:15.934 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 94/148 2020-11-20T12:12:16.228 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/148 2020-11-20T12:12:16.304 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 95/148 2020-11-20T12:12:16.526 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/148 2020-11-20T12:12:16.638 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/148 2020-11-20T12:12:16.676 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/148 2020-11-20T12:12:16.840 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 97/148 2020-11-20T12:12:20.486 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:20.701 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:21.486 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:21.967 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T12:12:22.062 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T12:12:22.191 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T12:12:23.480 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:23.807 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:24.797 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 98/148 2020-11-20T12:12:25.108 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T12:12:25.308 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 99/148 2020-11-20T12:12:25.454 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T12:12:29.808 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T12:12:29.808 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2020-11-20T12:12:29.808 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2020-11-20T12:12:29.808 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2020-11-20T12:12:29.809 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2020-11-20T12:12:29.809 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2020-11-20T12:12:29.809 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2020-11-20T12:12:29.809 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2020-11-20T12:12:29.810 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2020-11-20T12:12:29.810 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2020-11-20T12:12:29.810 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:12:30.225 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T12:12:30.665 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T12:12:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T12:12:32.368 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T12:12:32.559 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T12:12:32.590 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T12:12:32.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/148 2020-11-20T12:12:33.040 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/148 2020-11-20T12:12:33.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T12:12:33.918 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T12:12:34.205 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.5-12.el8.x86_64 107/148 2020-11-20T12:12:34.458 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.1-6.el8.noarch 108/148 2020-11-20T12:12:35.886 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T12:12:36.068 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T12:12:36.219 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 110/148 2020-11-20T12:12:36.388 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 111/148 2020-11-20T12:12:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T12:12:37.461 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T12:12:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T12:12:38.796 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T12:12:38.978 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T12:12:38.979 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2020-11-20T12:12:38.979 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2020-11-20T12:12:38.979 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2020-11-20T12:12:38.979 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /run 2020-11-20T12:12:38.980 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2020-11-20T12:12:38.980 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2020-11-20T12:12:38.980 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2020-11-20T12:12:38.980 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2020-11-20T12:12:38.981 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2020-11-20T12:12:38.981 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:12:39.048 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T12:12:39.130 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T12:12:39.357 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T12:12:39.804 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T12:12:39.998 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T12:12:40.112 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 115/148 2020-11-20T12:12:40.600 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T12:12:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T12:12:40.794 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T12:12:40.811 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T12:12:40.985 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 118/148 2020-11-20T12:12:41.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T12:12:41.523 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T12:12:41.731 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T12:12:41.763 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T12:12:41.929 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/148 2020-11-20T12:12:42.183 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/148 2020-11-20T12:12:42.364 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T12:12:42.433 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T12:12:42.711 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.5-12.el8.x86_64 107/148 2020-11-20T12:12:42.939 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.1-6.el8.noarch 108/148 2020-11-20T12:12:43.266 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 100/148 2020-11-20T12:12:43.267 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2020-11-20T12:12:43.267 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2020-11-20T12:12:43.268 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2020-11-20T12:12:43.268 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /run 2020-11-20T12:12:43.268 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2020-11-20T12:12:43.269 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2020-11-20T12:12:43.269 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2020-11-20T12:12:43.270 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2020-11-20T12:12:43.270 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2020-11-20T12:12:43.270 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:12:43.695 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T12:12:44.340 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 101/148 2020-11-20T12:12:44.555 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T12:12:44.785 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T12:12:44.932 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T12:12:45.096 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 110/148 2020-11-20T12:12:45.258 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 111/148 2020-11-20T12:12:45.430 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T12:12:45.809 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T12:12:46.293 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T12:12:46.415 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 102/148 2020-11-20T12:12:46.522 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T12:12:46.654 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T12:12:46.779 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 103/148 2020-11-20T12:12:47.004 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/148 2020-11-20T12:12:47.241 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/148 2020-11-20T12:12:47.353 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 120/148 2020-11-20T12:12:47.443 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T12:12:47.567 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T12:12:47.577 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T12:12:47.596 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 106/148 2020-11-20T12:12:47.760 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T12:12:47.843 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T12:12:47.951 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T12:12:47.996 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jq-1.5-12.el8.x86_64 107/148 2020-11-20T12:12:48.203 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T12:12:48.206 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 115/148 2020-11-20T12:12:48.277 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T12:12:48.285 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.1-6.el8.noarch 108/148 2020-11-20T12:12:48.397 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T12:12:48.425 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T12:12:48.605 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T12:12:48.619 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T12:12:48.790 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 118/148 2020-11-20T12:12:48.922 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T12:12:49.182 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 123/148 2020-11-20T12:12:49.470 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-11-20T12:12:49.688 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-11-20T12:12:49.920 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 126/148 2020-11-20T12:12:50.088 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-11-20T12:12:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-11-20T12:12:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-11-20T12:12:51.040 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T12:12:51.251 INFO:teuthology.orchestra.run.smithi134.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-11-20T12:12:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 131/148 2020-11-20T12:12:51.625 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 109/148 2020-11-20T12:12:51.753 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 132/148 2020-11-20T12:12:51.770 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 110/148 2020-11-20T12:12:51.968 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T12:12:52.031 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 111/148 2020-11-20T12:12:52.075 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T12:12:52.283 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T12:12:52.377 INFO:teuthology.orchestra.run.smithi134.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-11-20T12:12:52.563 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-11-20T12:12:52.751 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T12:12:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T12:12:53.067 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T12:12:53.097 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T12:12:53.303 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-11-20T12:12:53.305 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T12:12:53.440 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 112/148 2020-11-20T12:12:53.494 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-11-20T12:12:53.639 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-11-20T12:12:53.710 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T12:12:53.847 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-11-20T12:12:54.086 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-11-20T12:12:54.086 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T12:12:54.312 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T12:12:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T12:12:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:12:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:12:54.632 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 120/148 2020-11-20T12:12:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:12:54.813 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:12:54.838 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T12:12:55.011 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 113/148 2020-11-20T12:12:55.095 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:12:55.096 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T12:12:55.195 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T12:12:55.196 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T12:12:55.369 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T12:12:55.370 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T12:12:55.378 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 114/148 2020-11-20T12:12:55.821 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T12:12:55.828 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 115/148 2020-11-20T12:12:55.901 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T12:12:56.012 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T12:12:56.123 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 116/148 2020-11-20T12:12:56.265 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T12:12:56.266 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-11-20T12:12:56.266 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-11-20T12:12:56.266 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-11-20T12:12:56.266 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-11-20T12:12:56.266 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-11-20T12:12:56.267 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-11-20T12:12:56.267 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-11-20T12:12:56.267 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-11-20T12:12:56.267 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-11-20T12:12:56.268 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-11-20T12:12:56.268 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T12:12:56.268 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:12:56.268 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 13/148 2020-11-20T12:12:56.268 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 14/148 2020-11-20T12:12:56.269 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 15/148 2020-11-20T12:12:56.269 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 16/148 2020-11-20T12:12:56.269 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 17/148 2020-11-20T12:12:56.269 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 18/148 2020-11-20T12:12:56.270 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 19/148 2020-11-20T12:12:56.270 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 20/148 2020-11-20T12:12:56.270 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 21/148 2020-11-20T12:12:56.270 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 22/148 2020-11-20T12:12:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 23/148 2020-11-20T12:12:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 24/148 2020-11-20T12:12:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 25/148 2020-11-20T12:12:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 26/148 2020-11-20T12:12:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 27/148 2020-11-20T12:12:56.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 28/148 2020-11-20T12:12:56.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 29/148 2020-11-20T12:12:56.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/148 2020-11-20T12:12:56.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 31/148 2020-11-20T12:12:56.272 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 32/148 2020-11-20T12:12:56.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 33/148 2020-11-20T12:12:56.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 34/148 2020-11-20T12:12:56.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 35/148 2020-11-20T12:12:56.273 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 36/148 2020-11-20T12:12:56.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 37/148 2020-11-20T12:12:56.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 38/148 2020-11-20T12:12:56.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 39/148 2020-11-20T12:12:56.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 40/148 2020-11-20T12:12:56.274 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 41/148 2020-11-20T12:12:56.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 42/148 2020-11-20T12:12:56.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 43/148 2020-11-20T12:12:56.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 44/148 2020-11-20T12:12:56.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-11-20T12:12:56.275 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-11-20T12:12:56.276 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-11-20T12:12:56.276 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-11-20T12:12:56.276 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-11-20T12:12:56.276 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-11-20T12:12:56.276 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-11-20T12:12:56.277 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-11-20T12:12:56.277 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-11-20T12:12:56.277 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-11-20T12:12:56.277 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-11-20T12:12:56.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-11-20T12:12:56.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-11-20T12:12:56.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-11-20T12:12:56.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-11-20T12:12:56.278 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-11-20T12:12:56.279 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-11-20T12:12:56.279 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-11-20T12:12:56.279 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-11-20T12:12:56.279 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-11-20T12:12:56.280 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-11-20T12:12:56.280 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-11-20T12:12:56.280 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-11-20T12:12:56.280 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-11-20T12:12:56.280 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-11-20T12:12:56.281 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-11-20T12:12:56.281 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-11-20T12:12:56.281 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-11-20T12:12:56.281 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-11-20T12:12:56.282 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-11-20T12:12:56.282 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-11-20T12:12:56.282 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-11-20T12:12:56.282 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-11-20T12:12:56.283 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-11-20T12:12:56.283 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-11-20T12:12:56.283 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-11-20T12:12:56.283 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-11-20T12:12:56.283 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-11-20T12:12:56.284 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-11-20T12:12:56.284 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T12:12:56.284 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-11-20T12:12:56.284 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-11-20T12:12:56.285 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-11-20T12:12:56.285 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-11-20T12:12:56.285 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-11-20T12:12:56.285 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-11-20T12:12:56.285 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-11-20T12:12:56.286 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-11-20T12:12:56.286 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-11-20T12:12:56.286 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-11-20T12:12:56.286 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-11-20T12:12:56.286 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-11-20T12:12:56.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-11-20T12:12:56.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-11-20T12:12:56.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-11-20T12:12:56.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-11-20T12:12:56.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-11-20T12:12:56.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-11-20T12:12:56.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-11-20T12:12:56.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-11-20T12:12:56.288 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-11-20T12:12:56.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-11-20T12:12:56.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-11-20T12:12:56.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-11-20T12:12:56.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-11-20T12:12:56.289 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-11-20T12:12:56.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-11-20T12:12:56.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-11-20T12:12:56.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-11-20T12:12:56.290 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-11-20T12:12:56.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-11-20T12:12:56.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-11-20T12:12:56.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-11-20T12:12:56.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-11-20T12:12:56.291 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-11-20T12:12:56.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-11-20T12:12:56.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-11-20T12:12:56.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-11-20T12:12:56.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-11-20T12:12:56.292 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-11-20T12:12:56.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-11-20T12:12:56.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/148 2020-11-20T12:12:56.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-11-20T12:12:56.293 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-11-20T12:12:56.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-11-20T12:12:56.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/148 2020-11-20T12:12:56.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-11-20T12:12:56.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-11-20T12:12:56.294 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-11-20T12:12:56.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-11-20T12:12:56.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-11-20T12:12:56.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-11-20T12:12:56.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 137/148 2020-11-20T12:12:56.295 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-11-20T12:12:56.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 139/148 2020-11-20T12:12:56.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-11-20T12:12:56.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-11-20T12:12:56.296 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-11-20T12:12:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-11-20T12:12:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T12:12:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-11-20T12:12:56.297 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:12:56.298 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-11-20T12:12:56.958 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T12:12:57.009 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 117/148 2020-11-20T12:12:57.148 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 123/148 2020-11-20T12:12:57.268 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 118/148 2020-11-20T12:12:57.390 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-11-20T12:12:57.424 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T12:12:57.573 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-11-20T12:12:57.748 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 126/148 2020-11-20T12:12:57.940 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-11-20T12:12:58.111 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-11-20T12:12:58.522 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-11-20T12:12:58.544 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-11-20T12:12:58.544 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:12:58.545 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2020-11-20T12:12:58.545 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.545 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.545 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:12:58.546 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:12:58.546 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:12:58.546 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:12:58.546 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:12:58.546 INFO:teuthology.orchestra.run.smithi134.stdout:Downgraded: 2020-11-20T12:12:58.547 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T12:12:58.547 INFO:teuthology.orchestra.run.smithi134.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:12:58.547 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:12:58.547 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:12:58.547 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2020-11-20T12:12:58.548 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.548 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.548 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.548 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.549 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.549 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.549 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.549 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.550 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.550 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.550 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.550 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.550 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.551 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.551 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.551 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.551 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.552 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.552 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.552 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.552 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.552 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.553 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T12:12:58.553 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T12:12:58.553 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T12:12:58.553 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T12:12:58.553 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T12:12:58.554 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T12:12:58.554 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:12:58.554 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T12:12:58.554 INFO:teuthology.orchestra.run.smithi134.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T12:12:58.554 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T12:12:58.555 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.555 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.555 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.555 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.556 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.556 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.556 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.556 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.557 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:12:58.557 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.557 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.557 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:12:58.558 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T12:12:58.558 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.5-12.el8.x86_64 2020-11-20T12:12:58.558 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T12:12:58.558 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T12:12:58.558 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T12:12:58.559 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T12:12:58.559 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T12:12:58.559 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T12:12:58.559 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T12:12:58.559 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T12:12:58.560 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T12:12:58.560 INFO:teuthology.orchestra.run.smithi134.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T12:12:58.560 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T12:12:58.560 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T12:12:58.561 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T12:12:58.561 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T12:12:58.561 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T12:12:58.561 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T12:12:58.561 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T12:12:58.562 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T12:12:58.562 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T12:12:58.562 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T12:12:58.562 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T12:12:58.562 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T12:12:58.563 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T12:12:58.563 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T12:12:58.563 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T12:12:58.564 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T12:12:58.564 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T12:12:58.564 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T12:12:58.564 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T12:12:58.565 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T12:12:58.565 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T12:12:58.565 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T12:12:58.566 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T12:12:58.566 INFO:teuthology.orchestra.run.smithi134.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T12:12:58.566 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T12:12:58.567 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T12:12:58.567 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T12:12:58.567 INFO:teuthology.orchestra.run.smithi134.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T12:12:58.567 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T12:12:58.568 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T12:12:58.568 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T12:12:58.568 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T12:12:58.569 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T12:12:58.569 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T12:12:58.570 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T12:12:58.570 INFO:teuthology.orchestra.run.smithi134.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T12:12:58.571 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T12:12:58.571 INFO:teuthology.orchestra.run.smithi134.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T12:12:58.571 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T12:12:58.572 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T12:12:58.572 INFO:teuthology.orchestra.run.smithi134.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T12:12:58.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T12:12:58.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T12:12:58.573 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T12:12:58.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T12:12:58.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T12:12:58.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T12:12:58.574 INFO:teuthology.orchestra.run.smithi134.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T12:12:58.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T12:12:58.575 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T12:12:58.577 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T12:12:58.577 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T12:12:58.578 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T12:12:58.578 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T12:12:58.579 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T12:12:58.579 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T12:12:58.580 INFO:teuthology.orchestra.run.smithi134.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T12:12:58.581 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T12:12:58.582 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T12:12:58.582 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T12:12:58.583 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T12:12:58.583 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T12:12:58.584 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T12:12:58.584 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T12:12:58.584 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T12:12:58.585 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T12:12:58.585 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T12:12:58.586 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T12:12:58.586 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T12:12:58.586 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T12:12:58.587 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:12:58.588 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2020-11-20T12:12:58.698 DEBUG:teuthology.parallel:result is None 2020-11-20T12:12:59.030 INFO:teuthology.orchestra.run.smithi150.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-11-20T12:12:59.095 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 131/148 2020-11-20T12:12:59.314 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 132/148 2020-11-20T12:12:59.512 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T12:12:59.635 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T12:12:59.896 INFO:teuthology.orchestra.run.smithi150.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-11-20T12:13:00.075 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-11-20T12:13:00.287 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T12:13:00.365 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T12:13:00.562 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T12:13:00.597 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T12:13:00.788 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-11-20T12:13:00.930 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-11-20T12:13:01.066 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-11-20T12:13:01.257 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-11-20T12:13:01.497 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-11-20T12:13:01.497 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T12:13:01.706 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T12:13:01.805 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T12:13:01.818 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:13:01.819 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:13:02.090 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:13:02.091 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:13:02.323 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:13:02.323 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T12:13:02.494 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/148 2020-11-20T12:13:02.592 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T12:13:02.593 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T12:13:03.420 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T12:13:03.420 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-11-20T12:13:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-11-20T12:13:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-11-20T12:13:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-11-20T12:13:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-11-20T12:13:03.421 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-11-20T12:13:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-11-20T12:13:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-11-20T12:13:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-11-20T12:13:03.422 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-11-20T12:13:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T12:13:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:13:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 13/148 2020-11-20T12:13:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 14/148 2020-11-20T12:13:03.423 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 15/148 2020-11-20T12:13:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 16/148 2020-11-20T12:13:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 17/148 2020-11-20T12:13:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 18/148 2020-11-20T12:13:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 19/148 2020-11-20T12:13:03.424 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 20/148 2020-11-20T12:13:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 21/148 2020-11-20T12:13:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 22/148 2020-11-20T12:13:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 23/148 2020-11-20T12:13:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 24/148 2020-11-20T12:13:03.425 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 25/148 2020-11-20T12:13:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 26/148 2020-11-20T12:13:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 27/148 2020-11-20T12:13:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 28/148 2020-11-20T12:13:03.426 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 29/148 2020-11-20T12:13:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/148 2020-11-20T12:13:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 31/148 2020-11-20T12:13:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 32/148 2020-11-20T12:13:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 33/148 2020-11-20T12:13:03.427 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 34/148 2020-11-20T12:13:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 35/148 2020-11-20T12:13:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 36/148 2020-11-20T12:13:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 37/148 2020-11-20T12:13:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 38/148 2020-11-20T12:13:03.428 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 39/148 2020-11-20T12:13:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 40/148 2020-11-20T12:13:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 41/148 2020-11-20T12:13:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 42/148 2020-11-20T12:13:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 43/148 2020-11-20T12:13:03.429 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 44/148 2020-11-20T12:13:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-11-20T12:13:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-11-20T12:13:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-11-20T12:13:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-11-20T12:13:03.430 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-11-20T12:13:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-11-20T12:13:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-11-20T12:13:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-11-20T12:13:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-11-20T12:13:03.431 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-11-20T12:13:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-11-20T12:13:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-11-20T12:13:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-11-20T12:13:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-11-20T12:13:03.432 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-11-20T12:13:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-11-20T12:13:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-11-20T12:13:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-11-20T12:13:03.433 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-11-20T12:13:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-11-20T12:13:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-11-20T12:13:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-11-20T12:13:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-11-20T12:13:03.434 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-11-20T12:13:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-11-20T12:13:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-11-20T12:13:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-11-20T12:13:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-11-20T12:13:03.435 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-11-20T12:13:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-11-20T12:13:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-11-20T12:13:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-11-20T12:13:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-11-20T12:13:03.436 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-11-20T12:13:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-11-20T12:13:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-11-20T12:13:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-11-20T12:13:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-11-20T12:13:03.437 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-11-20T12:13:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T12:13:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-11-20T12:13:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-11-20T12:13:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-11-20T12:13:03.438 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-11-20T12:13:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-11-20T12:13:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-11-20T12:13:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-11-20T12:13:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-11-20T12:13:03.439 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-11-20T12:13:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-11-20T12:13:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-11-20T12:13:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-11-20T12:13:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-11-20T12:13:03.440 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-11-20T12:13:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-11-20T12:13:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-11-20T12:13:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-11-20T12:13:03.441 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-11-20T12:13:03.442 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-11-20T12:13:03.442 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-11-20T12:13:03.442 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-11-20T12:13:03.442 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-11-20T12:13:03.442 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-11-20T12:13:03.443 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-11-20T12:13:03.443 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-11-20T12:13:03.443 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-11-20T12:13:03.443 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-11-20T12:13:03.443 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-11-20T12:13:03.444 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-11-20T12:13:03.444 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-11-20T12:13:03.444 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-11-20T12:13:03.444 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-11-20T12:13:03.444 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-11-20T12:13:03.445 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-11-20T12:13:03.445 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-11-20T12:13:03.445 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-11-20T12:13:03.445 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-11-20T12:13:03.445 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-11-20T12:13:03.446 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-11-20T12:13:03.446 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-11-20T12:13:03.446 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-11-20T12:13:03.446 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/148 2020-11-20T12:13:03.446 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-11-20T12:13:03.447 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-11-20T12:13:03.447 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-11-20T12:13:03.447 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/148 2020-11-20T12:13:03.447 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-11-20T12:13:03.447 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-11-20T12:13:03.448 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-11-20T12:13:03.448 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-11-20T12:13:03.448 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-11-20T12:13:03.448 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-11-20T12:13:03.448 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 137/148 2020-11-20T12:13:03.449 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-11-20T12:13:03.449 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 139/148 2020-11-20T12:13:03.449 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-11-20T12:13:03.449 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-11-20T12:13:03.449 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-11-20T12:13:03.450 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-11-20T12:13:03.450 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T12:13:03.450 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-11-20T12:13:03.450 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:13:03.450 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-11-20T12:13:04.064 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 120/148 2020-11-20T12:13:04.300 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T12:13:04.831 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 121/148 2020-11-20T12:13:05.033 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T12:13:05.104 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-11-20T12:13:05.105 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:05.105 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2020-11-20T12:13:05.105 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:05.106 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:05.107 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:05.107 INFO:teuthology.orchestra.run.smithi150.stdout:Downgraded: 2020-11-20T12:13:05.107 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T12:13:05.107 INFO:teuthology.orchestra.run.smithi150.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:13:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:13:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:05.108 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2020-11-20T12:13:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.108 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.109 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.110 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.110 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.110 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.110 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.111 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.112 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T12:13:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T12:13:05.113 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T12:13:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T12:13:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T12:13:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T12:13:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:13:05.114 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T12:13:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T12:13:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T12:13:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.115 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.116 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.117 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T12:13:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: jq-1.5-12.el8.x86_64 2020-11-20T12:13:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T12:13:05.118 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T12:13:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T12:13:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T12:13:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T12:13:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T12:13:05.119 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T12:13:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T12:13:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T12:13:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T12:13:05.120 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T12:13:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T12:13:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T12:13:05.121 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T12:13:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T12:13:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T12:13:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T12:13:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T12:13:05.122 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T12:13:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T12:13:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T12:13:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T12:13:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T12:13:05.123 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T12:13:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T12:13:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T12:13:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T12:13:05.124 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T12:13:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T12:13:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T12:13:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T12:13:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T12:13:05.125 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T12:13:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T12:13:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T12:13:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T12:13:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T12:13:05.126 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T12:13:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T12:13:05.127 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T12:13:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T12:13:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T12:13:05.128 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T12:13:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T12:13:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T12:13:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T12:13:05.129 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T12:13:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T12:13:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T12:13:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T12:13:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T12:13:05.130 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T12:13:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T12:13:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T12:13:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T12:13:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T12:13:05.131 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T12:13:05.132 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T12:13:05.132 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T12:13:05.133 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T12:13:05.133 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T12:13:05.133 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T12:13:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T12:13:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T12:13:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T12:13:05.134 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T12:13:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T12:13:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T12:13:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T12:13:05.135 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T12:13:05.136 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T12:13:05.136 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T12:13:05.136 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T12:13:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T12:13:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T12:13:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T12:13:05.137 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T12:13:05.138 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T12:13:05.138 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:05.139 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2020-11-20T12:13:05.228 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 122/148 2020-11-20T12:13:05.276 DEBUG:teuthology.parallel:result is None 2020-11-20T12:13:06.639 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 123/148 2020-11-20T12:13:06.916 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 124/148 2020-11-20T12:13:07.128 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 125/148 2020-11-20T12:13:07.308 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 126/148 2020-11-20T12:13:07.501 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 127/148 2020-11-20T12:13:07.741 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 128/148 2020-11-20T12:13:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 129/148 2020-11-20T12:13:08.786 INFO:teuthology.orchestra.run.smithi160.stdout: Downgrading : krb5-workstation-1.17-9.el8.x86_64 130/148 2020-11-20T12:13:09.028 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 131/148 2020-11-20T12:13:09.276 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 132/148 2020-11-20T12:13:09.507 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T12:13:09.757 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 133/148 2020-11-20T12:13:10.035 INFO:teuthology.orchestra.run.smithi160.stdout: Downgrading : openssl-1:1.1.1c-2.el8_1.1.x86_64 134/148 2020-11-20T12:13:10.284 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/148 2020-11-20T12:13:10.481 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T12:13:10.664 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/148 2020-11-20T12:13:10.864 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T12:13:10.936 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/148 2020-11-20T12:13:11.145 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : krb5-workstation-1.17-18.el8.x86_64 138/148 2020-11-20T12:13:11.303 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.20.0-3.el8.x86_64 139/148 2020-11-20T12:13:11.513 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : libkadm5-1.17-18.el8.x86_64 140/148 2020-11-20T12:13:11.702 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:1.1.1c-15.el8.x86_64 141/148 2020-11-20T12:13:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : krb5-libs-1.17-18.el8.x86_64 142/148 2020-11-20T12:13:12.422 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T12:13:12.422 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 143/148 2020-11-20T12:13:12.422 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T12:13:12.423 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:13:12.424 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:13:12.753 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.20.0-3.el8.x86_64 145/148 2020-11-20T12:13:12.754 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:13:13.062 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:13:13.062 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T12:13:13.359 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 147/148 2020-11-20T12:13:13.360 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T12:13:14.726 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:1.1.1c-15.el8.x86_64 148/148 2020-11-20T12:13:14.727 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-libs-1.17-9.el8.x86_64 1/148 2020-11-20T12:13:14.727 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-libs-1.17-18.el8.x86_64 2/148 2020-11-20T12:13:14.728 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-workstation-1.17-9.el8.x86_64 3/148 2020-11-20T12:13:14.728 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-workstation-1.17-18.el8.x86_64 4/148 2020-11-20T12:13:14.729 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libkadm5-1.17-9.el8.x86_64 5/148 2020-11-20T12:13:14.729 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libkadm5-1.17-18.el8.x86_64 6/148 2020-11-20T12:13:14.729 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:1.1.1c-2.el8_1.1.x86_64 7/148 2020-11-20T12:13:14.730 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:1.1.1c-15.el8.x86_64 8/148 2020-11-20T12:13:14.730 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 9/148 2020-11-20T12:13:14.730 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:1.1.1c-15.el8.x86_64 10/148 2020-11-20T12:13:14.731 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 11/148 2020-11-20T12:13:14.731 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 12/148 2020-11-20T12:13:14.732 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 13/148 2020-11-20T12:13:14.732 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 14/148 2020-11-20T12:13:14.732 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 15/148 2020-11-20T12:13:14.733 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 16/148 2020-11-20T12:13:14.733 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 17/148 2020-11-20T12:13:14.733 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 18/148 2020-11-20T12:13:14.734 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 19/148 2020-11-20T12:13:14.734 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 20/148 2020-11-20T12:13:14.734 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 21/148 2020-11-20T12:13:14.734 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 22/148 2020-11-20T12:13:14.734 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 23/148 2020-11-20T12:13:14.735 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 24/148 2020-11-20T12:13:14.735 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 25/148 2020-11-20T12:13:14.735 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 26/148 2020-11-20T12:13:14.735 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 27/148 2020-11-20T12:13:14.735 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 28/148 2020-11-20T12:13:14.736 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 29/148 2020-11-20T12:13:14.736 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/148 2020-11-20T12:13:14.736 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 31/148 2020-11-20T12:13:14.736 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 32/148 2020-11-20T12:13:14.736 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 33/148 2020-11-20T12:13:14.737 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 34/148 2020-11-20T12:13:14.737 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 35/148 2020-11-20T12:13:14.737 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 36/148 2020-11-20T12:13:14.737 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 37/148 2020-11-20T12:13:14.738 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 38/148 2020-11-20T12:13:14.738 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 39/148 2020-11-20T12:13:14.738 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 40/148 2020-11-20T12:13:14.738 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 41/148 2020-11-20T12:13:14.739 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 42/148 2020-11-20T12:13:14.739 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 43/148 2020-11-20T12:13:14.739 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 44/148 2020-11-20T12:13:14.739 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.1-6.el8.noarch 45/148 2020-11-20T12:13:14.739 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.0.4-10.el8.x86_64 46/148 2020-11-20T12:13:14.740 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.1-9.el8.x86_64 47/148 2020-11-20T12:13:14.740 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jq-1.5-12.el8.x86_64 48/148 2020-11-20T12:13:14.740 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 49/148 2020-11-20T12:13:14.740 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 50/148 2020-11-20T12:13:14.740 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 51/148 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 52/148 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 53/148 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 54/148 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 55/148 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 56/148 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 57/148 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 58/148 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 59/148 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 60/148 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 61/148 2020-11-20T12:13:14.743 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 62/148 2020-11-20T12:13:14.743 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 63/148 2020-11-20T12:13:14.743 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 64/148 2020-11-20T12:13:14.743 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 65/148 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 66/148 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 67/148 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 68/148 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 69/148 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 70/148 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 71/148 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 72/148 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 73/148 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 74/148 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 75/148 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/148 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 77/148 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/148 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 79/148 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 80/148 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 81/148 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 82/148 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 83/148 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 84/148 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 85/148 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 86/148 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 87/148 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 88/148 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 89/148 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 90/148 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 91/148 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 92/148 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 93/148 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 94/148 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 95/148 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 96/148 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 97/148 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 98/148 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 99/148 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 100/148 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 101/148 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/148 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : leveldb-1.22-1.el8.x86_64 103/148 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 104/148 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 105/148 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 106/148 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 107/148 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 108/148 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 109/148 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 110/148 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 111/148 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 112/148 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 113/148 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 114/148 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 115/148 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 116/148 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 117/148 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 118/148 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 119/148 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 120/148 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 121/148 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-2.6-1.el8.noarch 122/148 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 123/148 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 124/148 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 125/148 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 126/148 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 127/148 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 128/148 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 129/148 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 130/148 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 131/148 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 132/148 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 133/148 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 134/148 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 135/148 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 136/148 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 137/148 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 138/148 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 139/148 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 140/148 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.20.0-5.el8_1.x86_64 141/148 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.20.0-3.el8.x86_64 142/148 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 143/148 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.20.0-3.el8.x86_64 144/148 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.20.0-5.el8_1.x86_64 145/148 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.20.0-3.el8.x86_64 146/148 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 147/148 2020-11-20T12:13:16.530 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.20.0-3.el8.x86_64 148/148 2020-11-20T12:13:16.530 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:16.530 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2020-11-20T12:13:16.530 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.531 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.531 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:16.531 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:16.531 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:16.532 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.20.0-5.el8_1.x86_64 2020-11-20T12:13:16.532 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:16.532 INFO:teuthology.orchestra.run.smithi160.stdout:Downgraded: 2020-11-20T12:13:16.532 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-libs-1.17-9.el8.x86_64 krb5-workstation-1.17-9.el8.x86_64 2020-11-20T12:13:16.532 INFO:teuthology.orchestra.run.smithi160.stdout: libkadm5-1.17-9.el8.x86_64 openssl-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:13:16.533 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:13:16.533 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:16.533 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2020-11-20T12:13:16.533 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.533 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.534 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.534 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.534 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.534 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.535 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.535 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.535 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.535 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.535 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.536 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.536 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.536 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.536 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.536 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.537 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.537 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.537 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.537 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.538 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.538 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.538 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T12:13:16.538 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T12:13:16.538 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T12:13:16.539 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-11-20T12:13:16.539 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T12:13:16.539 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-11-20T12:13:16.539 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:1.1.1c-2.el8_1.1.x86_64 2020-11-20T12:13:16.539 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-11-20T12:13:16.540 INFO:teuthology.orchestra.run.smithi160.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T12:13:16.540 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T12:13:16.540 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.540 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.541 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.541 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.541 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.541 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.541 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.542 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.542 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:16.542 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.543 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.543 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:16.543 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T12:13:16.543 INFO:teuthology.orchestra.run.smithi160.stdout: jq-1.5-12.el8.x86_64 2020-11-20T12:13:16.543 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T12:13:16.544 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T12:13:16.544 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-11-20T12:13:16.544 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.3-2.el8.x86_64 2020-11-20T12:13:16.544 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-11-20T12:13:16.544 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T12:13:16.545 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T12:13:16.545 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T12:13:16.545 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T12:13:16.545 INFO:teuthology.orchestra.run.smithi160.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T12:13:16.546 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T12:13:16.546 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T12:13:16.546 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:16.546 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:16.546 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T12:13:16.547 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T12:13:16.547 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T12:13:16.547 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T12:13:16.547 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-11-20T12:13:16.547 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T12:13:16.548 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T12:13:16.548 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.3.2-6.el8.x86_64 2020-11-20T12:13:16.548 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T12:13:16.548 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T12:13:16.548 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T12:13:16.549 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel-1.17-9.el8.x86_64 2020-11-20T12:13:16.549 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-11-20T12:13:16.549 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-11-20T12:13:16.549 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-11-20T12:13:16.549 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-11-20T12:13:16.550 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-11-20T12:13:16.550 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T12:13:16.550 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T12:13:16.550 INFO:teuthology.orchestra.run.smithi160.stdout: libxslt-1.1.32-3.el8.x86_64 2020-11-20T12:13:16.551 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-11-20T12:13:16.551 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-11-20T12:13:16.551 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-11-20T12:13:16.551 INFO:teuthology.orchestra.run.smithi160.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-11-20T12:13:16.551 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T12:13:16.552 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T12:13:16.552 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-11-20T12:13:16.552 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-11-20T12:13:16.552 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T12:13:16.552 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-11-20T12:13:16.553 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-11-20T12:13:16.553 INFO:teuthology.orchestra.run.smithi160.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T12:13:16.553 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T12:13:16.553 INFO:teuthology.orchestra.run.smithi160.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T12:13:16.554 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T12:13:16.554 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T12:13:16.554 INFO:teuthology.orchestra.run.smithi160.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T12:13:16.555 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T12:13:16.556 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T12:13:16.556 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T12:13:16.556 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T12:13:16.556 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T12:13:16.556 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T12:13:16.557 INFO:teuthology.orchestra.run.smithi160.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T12:13:16.557 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T12:13:16.557 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T12:13:16.557 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T12:13:16.558 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T12:13:16.558 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T12:13:16.558 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T12:13:16.558 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T12:13:16.558 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T12:13:16.559 INFO:teuthology.orchestra.run.smithi160.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T12:13:16.559 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T12:13:16.559 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T12:13:16.559 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T12:13:16.559 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T12:13:16.560 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T12:13:16.560 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T12:13:16.560 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T12:13:16.560 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T12:13:16.560 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T12:13:16.561 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T12:13:16.561 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T12:13:16.561 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T12:13:16.561 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T12:13:16.561 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:16.562 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2020-11-20T12:13:16.842 DEBUG:teuthology.parallel:result is None 2020-11-20T12:13:16.842 INFO:teuthology.orchestra.run.smithi160:> sudo lsb_release -is 2020-11-20T12:13:16.978 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS 2020-11-20T12:13:16.981 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:13:16.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:13:17.148 INFO:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T12:13:17.202 INFO:teuthology.orchestra.run.smithi160.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.203 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.204 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T12:13:17.204 INFO:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2020-11-20T12:13:17.259 INFO:teuthology.orchestra.run.smithi150.stdout:CentOS 2020-11-20T12:13:17.261 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:13:17.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:13:17.423 INFO:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T12:13:17.445 INFO:teuthology.orchestra.run.smithi150.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.445 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.446 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T12:13:17.446 INFO:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2020-11-20T12:13:17.502 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS 2020-11-20T12:13:17.503 DEBUG:teuthology.misc:System to be installed: CentOS 2020-11-20T12:13:17.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:13:17.675 INFO:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T12:13:17.710 INFO:teuthology.orchestra.run.smithi134.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.711 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.713 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T12:13:17.714 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T12:13:17.715 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:17.715 INFO:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:17.773 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:17.814 INFO:teuthology.orchestra.run.smithi160.stderr:24+1 records in 2020-11-20T12:13:17.814 INFO:teuthology.orchestra.run.smithi160.stderr:24+1 records out 2020-11-20T12:13:17.815 INFO:teuthology.orchestra.run.smithi160.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000279122 s, 45.4 MB/s 2020-11-20T12:13:17.818 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:17.818 INFO:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:17.836 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:17.889 INFO:teuthology.orchestra.run.smithi150.stderr:24+1 records in 2020-11-20T12:13:17.890 INFO:teuthology.orchestra.run.smithi150.stderr:24+1 records out 2020-11-20T12:13:17.890 INFO:teuthology.orchestra.run.smithi150.stderr:12667 bytes (13 kB, 12 KiB) copied, 9.8484e-05 s, 129 MB/s 2020-11-20T12:13:17.891 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:17.892 INFO:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:17.915 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:24+1 records in 2020-11-20T12:13:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:24+1 records out 2020-11-20T12:13:17.930 INFO:teuthology.orchestra.run.smithi134.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.2157e-05 s, 154 MB/s 2020-11-20T12:13:17.931 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T12:13:17.932 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:17.932 INFO:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:17.978 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.013 INFO:teuthology.orchestra.run.smithi160.stderr:5+1 records in 2020-11-20T12:13:18.014 INFO:teuthology.orchestra.run.smithi160.stderr:5+1 records out 2020-11-20T12:13:18.014 INFO:teuthology.orchestra.run.smithi160.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.000133308 s, 22.9 MB/s 2020-11-20T12:13:18.017 INFO:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T12:13:18.147 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:18.148 INFO:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.164 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.180 INFO:teuthology.orchestra.run.smithi150.stderr:5+1 records in 2020-11-20T12:13:18.180 INFO:teuthology.orchestra.run.smithi150.stderr:5+1 records out 2020-11-20T12:13:18.181 INFO:teuthology.orchestra.run.smithi150.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.2321e-05 s, 72.3 MB/s 2020-11-20T12:13:18.181 INFO:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T12:13:18.252 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:18.252 INFO:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.268 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.283 INFO:teuthology.orchestra.run.smithi134.stderr:5+1 records in 2020-11-20T12:13:18.283 INFO:teuthology.orchestra.run.smithi134.stderr:5+1 records out 2020-11-20T12:13:18.283 INFO:teuthology.orchestra.run.smithi134.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.3877e-05 s, 69.7 MB/s 2020-11-20T12:13:18.284 INFO:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T12:13:18.354 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T12:13:18.354 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:18.355 INFO:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.394 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.429 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:18.429 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:18.430 INFO:teuthology.orchestra.run.smithi160.stderr:299 bytes copied, 8.4819e-05 s, 3.5 MB/s 2020-11-20T12:13:18.431 INFO:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T12:13:18.550 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:18.551 INFO:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.567 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:18.581 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:18.582 INFO:teuthology.orchestra.run.smithi150.stderr:299 bytes copied, 3.3544e-05 s, 8.9 MB/s 2020-11-20T12:13:18.583 INFO:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T12:13:18.652 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:18.653 INFO:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.669 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.683 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:18.684 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:18.684 INFO:teuthology.orchestra.run.smithi134.stderr:299 bytes copied, 3.1219e-05 s, 9.6 MB/s 2020-11-20T12:13:18.685 INFO:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T12:13:18.755 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T12:13:18.810 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T12:13:18.811 INFO:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2020-11-20T12:13:18.814 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2020-11-20T12:13:18.816 INFO:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2020-11-20T12:13:18.898 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T12:13:18.974 INFO:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T12:13:18.999 INFO:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T12:13:19.006 INFO:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T12:13:19.102 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T12:13:19.103 INFO:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T12:13:19.115 INFO:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T12:13:19.125 INFO:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T12:13:19.696 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T12:13:19.696 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T12:13:19.697 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T12:13:19.697 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:19.697 INFO:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.744 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.748 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:19.750 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:19.750 INFO:teuthology.orchestra.run.smithi160.stderr:408 bytes copied, 0.000125513 s, 3.3 MB/s 2020-11-20T12:13:19.751 INFO:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:19.996 INFO:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:20.076 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:20.076 INFO:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:20.097 INFO:teuthology.orchestra.run.smithi150.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:20.098 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:20.099 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:20.099 INFO:teuthology.orchestra.run.smithi150.stderr:408 bytes copied, 0.000716693 s, 569 kB/s 2020-11-20T12:13:20.099 INFO:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:20.231 INFO:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:20.262 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:20.263 INFO:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:20.287 INFO:teuthology.orchestra.run.smithi134.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:20.291 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:20.291 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:20.291 INFO:teuthology.orchestra.run.smithi134.stderr:408 bytes copied, 0.0032225 s, 127 kB/s 2020-11-20T12:13:20.292 INFO:teuthology.orchestra.run.smithi134:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:20.429 INFO:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:20.474 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T12:13:20.474 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T12:13:20.475 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306', 'branch': 'wip-pdonnell-testing-20201120.053228', 'description': 'fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/suites/blogbench}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5640306', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.1', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20201120.053228'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd objectstore': 'filestore', 'osd sloppy crc': True}}, 'filestore': True, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'branch': 'wip-pdonnell-testing-20201120.053228', 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 95, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20201120.053228', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, {'ceph': None}, {'kclient': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-20_08:39:42', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.6033', 'targets': {'smithi160.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCo+TRHSYnEm+h6Ry340cUuh2DfBR5/7h+DjM5ECPn97djpQuw65WkBhercNn+/UPai0DANVsMR+P1JQdGe5lNEj0MRVzl6mQzg/fF/ps4sEUR5SKYsUODbqHzhlE874LPtsD8H2sIMs3SopWFunc/MpSABhjaVbC50xjxpzh9/a2rjYJ1vFETaP7B0pS2N2WwOIA3Y/RQWfMGEVJTGrahDaAkSa40mEBFu8D5Aw+0j8uVNxTUsla79YOJaxcWxkUob/4J+F21ptqEhHf7srkI+piPMfyJy7dU4jFFaAHHdT1fnwTiQWsN6n2HWjv84As2gg5WDlIWGI1J3IWecrBkw7iTYypvAatLfCkb6P/gQAf7HzYOpFDUFn0/ve1fXvHVZKHafy3PqYYgoBjYQtGzkgE5OF4CzsJFiq7+Y0WDEKO3j9HbPstLdBd8AnhYDpWyxflM5ldTiKNFTlJVYrvsWqDiRpcgdz1F73579DKKqW9iwFPN/HqXFCxOG7V7hf4M=', 'smithi150.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFQMGsQfTBZojVYLZMIqlbfnhE0snCxnCudGgIWaAqGRjyzfqDDaEWLillQ7kVsBR+z7TeF3PIXelX7J5pdd39Fx4gQ+FoznyGVVahFOc8s7rdusYGYh7uVoqppQBtMLB9GPF+ONEldqzQjg2LIOHIKy2sqFlmSR4BRJu767+zMwm7+GjkbyzzthHyOwgZzhFtuW+Hw69gWWtQbuWWOXH01trhR3rRKK5hmtRyAJGX/WMFN6Br8tnV3OG+bTZNhQHGZ3Jzk15S2i3Prp2nTHu2U+jAJASXghTciTgJk/pxx8EFUE+Es7XuhLVgo2vgpdR4wU4Qv1eRFHZpXfI7S4IfRkN0sZZGTbVwttXVspuFq4vsfr9yvHZV/tidmludIbUL/PP8Ueth+bZd/8UZe7MSJSFmeSzGq0fnjP3i7noZTwZVJVkW4Ukc+rY5mI48fHcN44kDwLmGHvimAeInxr0op6sv/Dt5ncZNeBT+d2EtC638MuZ/BuXh4pWUa3ZBGXM=', 'smithi134.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjrILcL5WftXLETNFUYPOvzDBxAp68JMK03EIqB6yoOotl063OozgSk8rC871QEdhchwihKoxxqVQeXr60wlmAm5Cqh5Em3AxLCUQK+5ruPpFxcmPRnyAMutDbVGtPZymlzUFDmj3yjlanDvjehtp8BpFQF8oLwpffO1tNkEdqnF1hzQ3iJWJjbnKyVJSP61WapoZyOydNIgIjawMYe3I2AuaXyuJekQSBDufs5o61jgW9wO5Th7NGx6E4v9cqD/Tcpw/tX28nL6xREXhYEOSKpd7BvknayOl0TLIvo/bZnWbLO7r3e6RVJE4DtMojMEFCPufMAH/Ae4u4veIES0W0ZAI6Fdt70wyOuHQh9cIygXWW5TqwaVNaou2HGutqPqNyDqJRNYhvoqEnnMu+i2a06yKnqjtGLqYGtC9wqH0sEwhsNRPfR1Gmhw+r/k2m6OX2ZHew7rfRxcMZ4B075vdHr9ACQd9IQ0YjveyBmNAQEf1s9nKHYezg8L75/Lm1b1U='}} 2020-11-20T12:13:20.476 INFO:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T12:13:20.521 INFO:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T12:13:20.542 INFO:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T12:13:20.589 INFO:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T12:13:20.601 INFO:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T12:13:20.609 INFO:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T12:13:20.718 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:20.718 INFO:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.762 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.764 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/vg_nvme/lv_1 2020-11-20T12:13:20.764 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/vg_nvme/lv_2 2020-11-20T12:13:20.764 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/vg_nvme/lv_3 2020-11-20T12:13:20.765 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/vg_nvme/lv_4 2020-11-20T12:13:20.765 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:20.765 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:20.765 INFO:teuthology.orchestra.run.smithi160.stderr:72 bytes copied, 0.000106584 s, 676 kB/s 2020-11-20T12:13:20.766 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T12:13:20.766 INFO:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T12:13:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T12:13:20.866 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.866 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 442 Links: 1 2020-11-20T12:13:20.867 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.867 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.867 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2020-11-20 12:13:14.147422556 +0000 2020-11-20T12:13:20.867 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2020-11-20 12:10:51.257589952 +0000 2020-11-20T12:13:20.867 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2020-11-20 12:10:51.257589952 +0000 2020-11-20T12:13:20.868 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2020-11-20T12:13:20.903 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2020-11-20T12:13:20.904 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2020-11-20T12:13:20.904 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000339407 s, 1.5 MB/s 2020-11-20T12:13:20.911 INFO:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T12:13:20.959 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T12:13:20.959 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.959 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 448 Links: 1 2020-11-20T12:13:20.960 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.960 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.960 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2020-11-20 12:13:14.148422541 +0000 2020-11-20T12:13:20.960 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2020-11-20 12:10:51.893583758 +0000 2020-11-20T12:13:20.960 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2020-11-20 12:10:51.893583758 +0000 2020-11-20T12:13:20.961 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2020-11-20T12:13:20.999 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2020-11-20T12:13:21.000 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2020-11-20T12:13:21.000 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000312939 s, 1.6 MB/s 2020-11-20T12:13:21.011 INFO:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T12:13:21.098 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T12:13:21.099 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.099 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 454 Links: 1 2020-11-20T12:13:21.099 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.100 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.100 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2020-11-20 12:13:14.148422541 +0000 2020-11-20T12:13:21.100 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2020-11-20 12:10:52.515577700 +0000 2020-11-20T12:13:21.100 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2020-11-20 12:10:52.515577700 +0000 2020-11-20T12:13:21.100 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2020-11-20T12:13:21.136 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2020-11-20T12:13:21.136 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2020-11-20T12:13:21.137 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000297901 s, 1.7 MB/s 2020-11-20T12:13:21.143 INFO:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T12:13:21.227 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T12:13:21.227 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.227 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 460 Links: 1 2020-11-20T12:13:21.228 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.228 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.228 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2020-11-20 12:13:14.148422541 +0000 2020-11-20T12:13:21.228 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2020-11-20 12:10:53.131571700 +0000 2020-11-20T12:13:21.228 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2020-11-20 12:10:53.131571700 +0000 2020-11-20T12:13:21.229 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2020-11-20T12:13:21.262 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2020-11-20T12:13:21.263 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2020-11-20T12:13:21.263 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000325422 s, 1.6 MB/s 2020-11-20T12:13:21.269 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:21.270 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:21.270 INFO:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:21.286 INFO:teuthology.orchestra.run.smithi150.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:21.288 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/vg_nvme/lv_1 2020-11-20T12:13:21.288 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/vg_nvme/lv_2 2020-11-20T12:13:21.289 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/vg_nvme/lv_3 2020-11-20T12:13:21.289 INFO:teuthology.orchestra.run.smithi150.stdout:/dev/vg_nvme/lv_4 2020-11-20T12:13:21.290 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:21.290 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:21.290 INFO:teuthology.orchestra.run.smithi150.stderr:72 bytes copied, 3.7921e-05 s, 1.9 MB/s 2020-11-20T12:13:21.291 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T12:13:21.292 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T12:13:21.344 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T12:13:21.345 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.345 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 64677 Links: 1 2020-11-20T12:13:21.345 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.345 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.346 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-11-20 12:13:03.055430153 +0000 2020-11-20T12:13:21.346 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-11-20 12:10:18.286162964 +0000 2020-11-20T12:13:21.346 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-11-20 12:10:18.286162964 +0000 2020-11-20T12:13:21.346 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-11-20T12:13:21.360 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-11-20T12:13:21.360 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-11-20T12:13:21.360 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000267962 s, 1.9 MB/s 2020-11-20T12:13:21.363 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T12:13:21.418 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T12:13:21.419 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.420 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 60014 Links: 1 2020-11-20T12:13:21.420 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.421 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.421 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-11-20 12:13:03.055430153 +0000 2020-11-20T12:13:21.421 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-11-20 12:10:18.617156509 +0000 2020-11-20T12:13:21.421 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-11-20 12:10:18.617156509 +0000 2020-11-20T12:13:21.422 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-11-20T12:13:21.432 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-11-20T12:13:21.433 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-11-20T12:13:21.433 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000198286 s, 2.6 MB/s 2020-11-20T12:13:21.435 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T12:13:21.491 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T12:13:21.491 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.491 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 62870 Links: 1 2020-11-20T12:13:21.491 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.492 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.492 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-11-20 12:13:03.055430153 +0000 2020-11-20T12:13:21.492 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-11-20 12:10:18.939150229 +0000 2020-11-20T12:13:21.492 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-11-20 12:10:18.939150229 +0000 2020-11-20T12:13:21.492 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-11-20T12:13:21.504 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-11-20T12:13:21.505 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-11-20T12:13:21.505 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000218803 s, 2.3 MB/s 2020-11-20T12:13:21.507 INFO:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 60113 Links: 1 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2020-11-20 12:13:03.055430153 +0000 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2020-11-20 12:10:19.306143072 +0000 2020-11-20T12:13:21.565 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2020-11-20 12:10:19.306143072 +0000 2020-11-20T12:13:21.565 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2020-11-20T12:13:21.577 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2020-11-20T12:13:21.577 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2020-11-20T12:13:21.578 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000196006 s, 2.6 MB/s 2020-11-20T12:13:21.580 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:21.580 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:21.581 INFO:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:21.598 INFO:teuthology.orchestra.run.smithi134.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:21.599 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/vg_nvme/lv_1 2020-11-20T12:13:21.599 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/vg_nvme/lv_2 2020-11-20T12:13:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/vg_nvme/lv_3 2020-11-20T12:13:21.600 INFO:teuthology.orchestra.run.smithi134.stdout:/dev/vg_nvme/lv_4 2020-11-20T12:13:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:21.600 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:21.601 INFO:teuthology.orchestra.run.smithi134.stderr:72 bytes copied, 3.7366e-05 s, 1.9 MB/s 2020-11-20T12:13:21.601 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T12:13:21.601 INFO:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T12:13:21.657 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T12:13:21.657 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.658 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 59150 Links: 1 2020-11-20T12:13:21.658 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.658 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.658 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2020-11-20 12:12:55.909432238 +0000 2020-11-20T12:13:21.658 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2020-11-20 12:10:18.284508319 +0000 2020-11-20T12:13:21.659 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2020-11-20 12:10:18.284508319 +0000 2020-11-20T12:13:21.659 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2020-11-20T12:13:21.672 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2020-11-20T12:13:21.673 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2020-11-20T12:13:21.673 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000230967 s, 2.2 MB/s 2020-11-20T12:13:21.675 INFO:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T12:13:21.732 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T12:13:21.733 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.733 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 63753 Links: 1 2020-11-20T12:13:21.733 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.734 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.734 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2020-11-20 12:12:55.909432238 +0000 2020-11-20T12:13:21.734 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2020-11-20 12:10:18.606501238 +0000 2020-11-20T12:13:21.734 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2020-11-20 12:10:18.606501238 +0000 2020-11-20T12:13:21.734 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2020-11-20T12:13:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2020-11-20T12:13:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2020-11-20T12:13:21.747 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00032398 s, 1.6 MB/s 2020-11-20T12:13:21.749 INFO:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T12:13:21.804 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T12:13:21.804 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.805 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 64537 Links: 1 2020-11-20T12:13:21.805 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.806 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.806 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2020-11-20 12:12:55.909432238 +0000 2020-11-20T12:13:21.806 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2020-11-20 12:10:18.941493872 +0000 2020-11-20T12:13:21.806 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2020-11-20 12:10:18.941493872 +0000 2020-11-20T12:13:21.807 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2020-11-20T12:13:21.818 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2020-11-20T12:13:21.818 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2020-11-20T12:13:21.818 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000198185 s, 2.6 MB/s 2020-11-20T12:13:21.821 INFO:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T12:13:21.876 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T12:13:21.877 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.877 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 59263 Links: 1 2020-11-20T12:13:21.877 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.877 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.877 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2020-11-20 12:12:55.909432238 +0000 2020-11-20T12:13:21.878 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2020-11-20 12:10:19.312485713 +0000 2020-11-20T12:13:21.878 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2020-11-20 12:10:19.312485713 +0000 2020-11-20T12:13:21.878 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2020-11-20T12:13:21.889 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2020-11-20T12:13:21.889 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2020-11-20T12:13:21.890 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000182475 s, 2.8 MB/s 2020-11-20T12:13:21.892 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:21.892 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T12:13:21.892 INFO:tasks.ceph:Generating config... 2020-11-20T12:13:21.894 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T12:13:21.894 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T12:13:21.894 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T12:13:21.895 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T12:13:21.895 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T12:13:21.895 INFO:tasks.ceph:[global] ms die on skipped message = False 2020-11-20T12:13:21.896 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T12:13:21.896 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T12:13:21.896 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T12:13:21.896 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T12:13:21.897 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T12:13:21.897 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T12:13:21.897 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T12:13:21.897 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T12:13:21.898 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T12:13:21.898 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T12:13:21.898 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T12:13:21.899 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T12:13:21.899 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T12:13:21.899 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T12:13:21.899 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T12:13:21.900 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T12:13:21.900 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T12:13:21.900 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T12:13:21.900 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T12:13:21.901 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T12:13:21.901 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T12:13:21.901 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T12:13:21.902 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T12:13:21.902 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T12:13:21.902 INFO:tasks.ceph:[osd] osd objectstore = filestore 2020-11-20T12:13:21.902 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T12:13:21.903 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-20T12:13:21.903 INFO:tasks.ceph:[osd] osd sloppy crc = True 2020-11-20T12:13:21.903 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2020-11-20T12:13:21.904 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T12:13:21.904 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T12:13:22.037 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T12:13:22.042 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T12:13:22.148 INFO:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:22.222 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.160'), ('mon.b', '172.21.15.150'), ('mon.c', '172.21.15.134')] 2020-11-20T12:13:22.223 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.160,172.21.15.150,172.21.15.134', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd sloppy crc': True, 'osd_max_omap_entries_per_request': 10000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2020-11-20T12:13:22.224 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:22.225 INFO:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T12:13:22.262 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T12:13:22.264 INFO:teuthology.orchestra.run.smithi160.stderr:6+1 records in 2020-11-20T12:13:22.264 INFO:teuthology.orchestra.run.smithi160.stderr:6+1 records out 2020-11-20T12:13:22.264 INFO:teuthology.orchestra.run.smithi160.stderr:3276 bytes (3.3 kB, 3.2 KiB) copied, 0.000132787 s, 24.7 MB/s 2020-11-20T12:13:22.265 INFO:teuthology.orchestra.run.smithi160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.160 --add b 172.21.15.150 --add c 172.21.15.134 --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:22.339 INFO:teuthology.orchestra.run.smithi160.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:22.339 INFO:teuthology.orchestra.run.smithi160.stdout:monmaptool: generated fsid 9013b66f-4346-4464-9f02-9fb5fd49fe5a 2020-11-20T12:13:22.339 INFO:teuthology.orchestra.run.smithi160.stdout:epoch 0 2020-11-20T12:13:22.340 INFO:teuthology.orchestra.run.smithi160.stdout:fsid 9013b66f-4346-4464-9f02-9fb5fd49fe5a 2020-11-20T12:13:22.340 INFO:teuthology.orchestra.run.smithi160.stdout:last_changed 2020-11-20T12:13:22.336836+0000 2020-11-20T12:13:22.340 INFO:teuthology.orchestra.run.smithi160.stdout:created 2020-11-20T12:13:22.336836+0000 2020-11-20T12:13:22.340 INFO:teuthology.orchestra.run.smithi160.stdout:min_mon_release 0 (unknown) 2020-11-20T12:13:22.341 INFO:teuthology.orchestra.run.smithi160.stdout:election_strategy: 1 2020-11-20T12:13:22.341 INFO:teuthology.orchestra.run.smithi160.stdout:0: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.a 2020-11-20T12:13:22.341 INFO:teuthology.orchestra.run.smithi160.stdout:1: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.b 2020-11-20T12:13:22.341 INFO:teuthology.orchestra.run.smithi160.stdout:2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.c 2020-11-20T12:13:22.341 INFO:teuthology.orchestra.run.smithi160.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T12:13:22.343 INFO:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T12:13:22.382 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9013b66f-4346-4464-9f02-9fb5fd49fe5a... 2020-11-20T12:13:22.383 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T12:13:22.387 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T12:13:22.390 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T12:13:22.444 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2020-11-20T12:13:22.444 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2020-11-20T12:13:22.445 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T12:13:22.445 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2020-11-20T12:13:22.445 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.446 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2020-11-20T12:13:22.446 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.446 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2020-11-20T12:13:22.446 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.446 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2020-11-20T12:13:22.447 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2020-11-20T12:13:22.447 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.447 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2020-11-20T12:13:22.447 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2020-11-20T12:13:22.447 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.448 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T12:13:22.448 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2020-11-20T12:13:22.448 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.448 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T12:13:22.448 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T12:13:22.449 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.449 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2020-11-20T12:13:22.449 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.450 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2020-11-20T12:13:22.450 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2020-11-20T12:13:22.450 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2020-11-20T12:13:22.451 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2020-11-20T12:13:22.451 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2020-11-20T12:13:22.451 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2020-11-20T12:13:22.452 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2020-11-20T12:13:22.452 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T12:13:22.452 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T12:13:22.453 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2020-11-20T12:13:22.453 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.453 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T12:13:22.453 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.454 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2020-11-20T12:13:22.454 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.454 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2020-11-20T12:13:22.454 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.455 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2020-11-20T12:13:22.455 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2020-11-20T12:13:22.455 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2020-11-20T12:13:22.455 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.160,172.21.15.150,172.21.15.134" 2020-11-20T12:13:22.455 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on skipped message = False 2020-11-20T12:13:22.456 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 9013b66f-4346-4464-9f02-9fb5fd49fe5a 2020-11-20T12:13:22.456 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.456 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2020-11-20T12:13:22.457 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2020-11-20T12:13:22.457 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.457 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2020-11-20T12:13:22.458 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2020-11-20T12:13:22.458 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.458 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2020-11-20T12:13:22.459 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2020-11-20T12:13:22.459 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.460 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2020-11-20T12:13:22.460 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2020-11-20T12:13:22.460 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2020-11-20T12:13:22.461 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.461 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2020-11-20T12:13:22.462 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2020-11-20T12:13:22.462 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.462 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2020-11-20T12:13:22.463 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.463 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2020-11-20T12:13:22.463 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.464 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2020-11-20T12:13:22.464 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.465 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2020-11-20T12:13:22.465 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2020-11-20T12:13:22.465 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.465 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2020-11-20T12:13:22.466 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2020-11-20T12:13:22.466 INFO:teuthology.orchestra.run.smithi134.stdout: debug filestore = 20 2020-11-20T12:13:22.466 INFO:teuthology.orchestra.run.smithi134.stdout: debug journal = 20 2020-11-20T12:13:22.466 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 20 2020-11-20T12:13:22.466 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 25 2020-11-20T12:13:22.467 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = filestore 2020-11-20T12:13:22.467 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2020-11-20T12:13:22.467 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2020-11-20T12:13:22.467 INFO:teuthology.orchestra.run.smithi134.stdout: osd sloppy crc = True 2020-11-20T12:13:22.468 INFO:teuthology.orchestra.run.smithi134.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T12:13:22.468 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.468 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2020-11-20T12:13:22.468 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2020-11-20T12:13:22.468 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2020-11-20T12:13:22.469 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2020-11-20T12:13:22.469 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2020-11-20T12:13:22.469 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:22.469 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:22.469 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2020-11-20T12:13:22.470 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.470 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2020-11-20T12:13:22.470 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2020-11-20T12:13:22.470 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2020-11-20T12:13:22.470 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2020-11-20T12:13:22.471 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2020-11-20T12:13:22.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2020-11-20T12:13:22.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2020-11-20T12:13:22.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:22.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2020-11-20T12:13:22.471 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2020-11-20T12:13:22.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:22.472 INFO:teuthology.orchestra.run.smithi134.stdout: mon op complaint time = 120 2020-11-20T12:13:22.472 INFO:teuthology.orchestra.run.smithi134.stdout: 2020-11-20T12:13:22.472 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2020-11-20T12:13:22.472 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2020-11-20T12:13:22.473 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2020-11-20T12:13:22.473 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2020-11-20T12:13:22.473 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T12:13:22.473 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T12:13:22.473 INFO:teuthology.orchestra.run.smithi134.stdout: client mount timeout = 600 2020-11-20T12:13:22.474 INFO:teuthology.orchestra.run.smithi134.stdout: debug client = 20 2020-11-20T12:13:22.474 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2020-11-20T12:13:22.474 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 15m 2020-11-20T12:13:22.474 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 15m 2020-11-20T12:13:22.474 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2020-11-20T12:13:22.475 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2020-11-20T12:13:22.475 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2020-11-20T12:13:22.475 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2020-11-20T12:13:22.475 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2020-11-20T12:13:22.475 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2020-11-20T12:13:22.476 INFO:teuthology.orchestra.run.smithi134.stdout:[mds] 2020-11-20T12:13:22.476 INFO:teuthology.orchestra.run.smithi134.stdout: debug mds = 20 2020-11-20T12:13:22.476 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2020-11-20T12:13:22.476 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal frag = True 2020-11-20T12:13:22.477 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal fragment size max = 10000 2020-11-20T12:13:22.477 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal merge size = 5 2020-11-20T12:13:22.477 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split bits = 3 2020-11-20T12:13:22.477 INFO:teuthology.orchestra.run.smithi134.stdout: mds bal split size = 100 2020-11-20T12:13:22.477 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug frag = True 2020-11-20T12:13:22.478 INFO:teuthology.orchestra.run.smithi134.stdout: mds debug scatterstat = True 2020-11-20T12:13:22.478 INFO:teuthology.orchestra.run.smithi134.stdout: mds op complaint time = 180 2020-11-20T12:13:22.478 INFO:teuthology.orchestra.run.smithi134.stdout: mds verify scatter = True 2020-11-20T12:13:22.478 INFO:teuthology.orchestra.run.smithi134.stdout: osd op complaint time = 180 2020-11-20T12:13:22.478 INFO:teuthology.orchestra.run.smithi134.stdout: rados mon op timeout = 15m 2020-11-20T12:13:22.479 INFO:teuthology.orchestra.run.smithi134.stdout: rados osd op timeout = 15m 2020-11-20T12:13:22.480 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2020-11-20T12:13:22.480 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2020-11-20T12:13:22.481 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T12:13:22.481 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2020-11-20T12:13:22.481 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.481 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2020-11-20T12:13:22.481 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.482 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2020-11-20T12:13:22.482 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.482 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2020-11-20T12:13:22.482 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2020-11-20T12:13:22.482 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.483 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2020-11-20T12:13:22.483 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2020-11-20T12:13:22.483 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.483 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T12:13:22.483 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2020-11-20T12:13:22.484 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.484 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T12:13:22.484 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T12:13:22.484 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.485 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2020-11-20T12:13:22.485 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.485 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2020-11-20T12:13:22.485 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2020-11-20T12:13:22.486 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2020-11-20T12:13:22.486 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2020-11-20T12:13:22.486 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2020-11-20T12:13:22.486 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2020-11-20T12:13:22.486 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2020-11-20T12:13:22.487 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T12:13:22.487 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T12:13:22.487 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2020-11-20T12:13:22.487 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.487 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T12:13:22.488 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.488 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2020-11-20T12:13:22.488 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.488 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2020-11-20T12:13:22.488 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.489 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2020-11-20T12:13:22.489 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2020-11-20T12:13:22.489 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2020-11-20T12:13:22.489 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.160,172.21.15.150,172.21.15.134" 2020-11-20T12:13:22.489 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on skipped message = False 2020-11-20T12:13:22.490 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 9013b66f-4346-4464-9f02-9fb5fd49fe5a 2020-11-20T12:13:22.490 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.490 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2020-11-20T12:13:22.491 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2020-11-20T12:13:22.491 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.491 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2020-11-20T12:13:22.491 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2020-11-20T12:13:22.491 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.492 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2020-11-20T12:13:22.492 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2020-11-20T12:13:22.492 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.492 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2020-11-20T12:13:22.493 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2020-11-20T12:13:22.493 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2020-11-20T12:13:22.493 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.493 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2020-11-20T12:13:22.494 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2020-11-20T12:13:22.494 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.494 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2020-11-20T12:13:22.494 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.494 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2020-11-20T12:13:22.495 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.495 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2020-11-20T12:13:22.495 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.495 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2020-11-20T12:13:22.496 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2020-11-20T12:13:22.496 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.496 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2020-11-20T12:13:22.496 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2020-11-20T12:13:22.496 INFO:teuthology.orchestra.run.smithi150.stdout: debug filestore = 20 2020-11-20T12:13:22.497 INFO:teuthology.orchestra.run.smithi150.stdout: debug journal = 20 2020-11-20T12:13:22.497 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 20 2020-11-20T12:13:22.497 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 25 2020-11-20T12:13:22.497 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = filestore 2020-11-20T12:13:22.497 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2020-11-20T12:13:22.498 INFO:teuthology.orchestra.run.smithi150.stdout: osd shutdown pgref assert = True 2020-11-20T12:13:22.498 INFO:teuthology.orchestra.run.smithi150.stdout: osd sloppy crc = True 2020-11-20T12:13:22.498 INFO:teuthology.orchestra.run.smithi150.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T12:13:22.499 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.499 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2020-11-20T12:13:22.499 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-11-20T12:13:22.500 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2020-11-20T12:13:22.500 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2020-11-20T12:13:22.501 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2020-11-20T12:13:22.501 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:22.501 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:22.502 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2020-11-20T12:13:22.502 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.503 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2020-11-20T12:13:22.503 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-11-20T12:13:22.503 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2020-11-20T12:13:22.504 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2020-11-20T12:13:22.504 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2020-11-20T12:13:22.504 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2020-11-20T12:13:22.505 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2020-11-20T12:13:22.505 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:22.506 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2020-11-20T12:13:22.506 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2020-11-20T12:13:22.506 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:22.507 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2020-11-20T12:13:22.507 INFO:teuthology.orchestra.run.smithi150.stdout: 2020-11-20T12:13:22.508 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2020-11-20T12:13:22.508 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2020-11-20T12:13:22.508 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2020-11-20T12:13:22.509 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2020-11-20T12:13:22.509 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T12:13:22.510 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T12:13:22.510 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2020-11-20T12:13:22.510 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2020-11-20T12:13:22.511 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-11-20T12:13:22.511 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 15m 2020-11-20T12:13:22.511 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 15m 2020-11-20T12:13:22.512 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2020-11-20T12:13:22.512 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2020-11-20T12:13:22.513 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2020-11-20T12:13:22.513 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2020-11-20T12:13:22.513 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2020-11-20T12:13:22.514 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2020-11-20T12:13:22.514 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2020-11-20T12:13:22.515 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2020-11-20T12:13:22.515 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2020-11-20T12:13:22.515 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal frag = True 2020-11-20T12:13:22.516 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal fragment size max = 10000 2020-11-20T12:13:22.516 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal merge size = 5 2020-11-20T12:13:22.517 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal split bits = 3 2020-11-20T12:13:22.517 INFO:teuthology.orchestra.run.smithi150.stdout: mds bal split size = 100 2020-11-20T12:13:22.517 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2020-11-20T12:13:22.518 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2020-11-20T12:13:22.518 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2020-11-20T12:13:22.519 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2020-11-20T12:13:22.519 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2020-11-20T12:13:22.519 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 15m 2020-11-20T12:13:22.520 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 15m 2020-11-20T12:13:22.593 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2020-11-20T12:13:22.593 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2020-11-20T12:13:22.593 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T12:13:22.594 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2020-11-20T12:13:22.594 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.594 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2020-11-20T12:13:22.594 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.595 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2020-11-20T12:13:22.595 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.595 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2020-11-20T12:13:22.595 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2020-11-20T12:13:22.596 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.596 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2020-11-20T12:13:22.596 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2020-11-20T12:13:22.596 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.596 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T12:13:22.597 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2020-11-20T12:13:22.597 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.597 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T12:13:22.597 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T12:13:22.597 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.598 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2020-11-20T12:13:22.598 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.598 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2020-11-20T12:13:22.598 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2020-11-20T12:13:22.598 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2020-11-20T12:13:22.599 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2020-11-20T12:13:22.599 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2020-11-20T12:13:22.599 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2020-11-20T12:13:22.599 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2020-11-20T12:13:22.599 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T12:13:22.600 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T12:13:22.600 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2020-11-20T12:13:22.600 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.600 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T12:13:22.600 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.601 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2020-11-20T12:13:22.601 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.601 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2020-11-20T12:13:22.601 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.602 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2020-11-20T12:13:22.602 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2020-11-20T12:13:22.602 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2020-11-20T12:13:22.602 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.160,172.21.15.150,172.21.15.134" 2020-11-20T12:13:22.602 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on skipped message = False 2020-11-20T12:13:22.603 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = 9013b66f-4346-4464-9f02-9fb5fd49fe5a 2020-11-20T12:13:22.603 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.603 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2020-11-20T12:13:22.603 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2020-11-20T12:13:22.603 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.604 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2020-11-20T12:13:22.604 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2020-11-20T12:13:22.604 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.605 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2020-11-20T12:13:22.605 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2020-11-20T12:13:22.605 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.606 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2020-11-20T12:13:22.606 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2020-11-20T12:13:22.606 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2020-11-20T12:13:22.607 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.607 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2020-11-20T12:13:22.608 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2020-11-20T12:13:22.608 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.608 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2020-11-20T12:13:22.609 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.609 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2020-11-20T12:13:22.610 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.610 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2020-11-20T12:13:22.610 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.611 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2020-11-20T12:13:22.611 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2020-11-20T12:13:22.612 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.612 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2020-11-20T12:13:22.612 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2020-11-20T12:13:22.613 INFO:teuthology.orchestra.run.smithi160.stdout: debug filestore = 20 2020-11-20T12:13:22.613 INFO:teuthology.orchestra.run.smithi160.stdout: debug journal = 20 2020-11-20T12:13:22.613 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 20 2020-11-20T12:13:22.614 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 25 2020-11-20T12:13:22.614 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = filestore 2020-11-20T12:13:22.614 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2020-11-20T12:13:22.614 INFO:teuthology.orchestra.run.smithi160.stdout: osd shutdown pgref assert = True 2020-11-20T12:13:22.615 INFO:teuthology.orchestra.run.smithi160.stdout: osd sloppy crc = True 2020-11-20T12:13:22.615 INFO:teuthology.orchestra.run.smithi160.stdout: osd_max_omap_entries_per_request = 10000 2020-11-20T12:13:22.615 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.615 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2020-11-20T12:13:22.615 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2020-11-20T12:13:22.616 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2020-11-20T12:13:22.616 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2020-11-20T12:13:22.616 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2020-11-20T12:13:22.616 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:22.616 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:22.617 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2020-11-20T12:13:22.617 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.617 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2020-11-20T12:13:22.617 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2020-11-20T12:13:22.617 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2020-11-20T12:13:22.618 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2020-11-20T12:13:22.618 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2020-11-20T12:13:22.618 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2020-11-20T12:13:22.618 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2020-11-20T12:13:22.618 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:22.619 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2020-11-20T12:13:22.619 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2020-11-20T12:13:22.619 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:22.619 INFO:teuthology.orchestra.run.smithi160.stdout: mon op complaint time = 120 2020-11-20T12:13:22.619 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:13:22.619 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2020-11-20T12:13:22.620 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2020-11-20T12:13:22.620 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2020-11-20T12:13:22.620 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2020-11-20T12:13:22.620 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T12:13:22.620 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T12:13:22.621 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 600 2020-11-20T12:13:22.621 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2020-11-20T12:13:22.621 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2020-11-20T12:13:22.621 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 15m 2020-11-20T12:13:22.621 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 15m 2020-11-20T12:13:22.622 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2020-11-20T12:13:22.622 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2020-11-20T12:13:22.622 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2020-11-20T12:13:22.622 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2020-11-20T12:13:22.622 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2020-11-20T12:13:22.623 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2020-11-20T12:13:22.623 INFO:teuthology.orchestra.run.smithi160.stdout:[mds] 2020-11-20T12:13:22.623 INFO:teuthology.orchestra.run.smithi160.stdout: debug mds = 20 2020-11-20T12:13:22.623 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2020-11-20T12:13:22.623 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal frag = True 2020-11-20T12:13:22.624 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal fragment size max = 10000 2020-11-20T12:13:22.624 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal merge size = 5 2020-11-20T12:13:22.624 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal split bits = 3 2020-11-20T12:13:22.624 INFO:teuthology.orchestra.run.smithi160.stdout: mds bal split size = 100 2020-11-20T12:13:22.624 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug frag = True 2020-11-20T12:13:22.625 INFO:teuthology.orchestra.run.smithi160.stdout: mds debug scatterstat = True 2020-11-20T12:13:22.625 INFO:teuthology.orchestra.run.smithi160.stdout: mds op complaint time = 180 2020-11-20T12:13:22.625 INFO:teuthology.orchestra.run.smithi160.stdout: mds verify scatter = True 2020-11-20T12:13:22.626 INFO:teuthology.orchestra.run.smithi160.stdout: osd op complaint time = 180 2020-11-20T12:13:22.626 INFO:teuthology.orchestra.run.smithi160.stdout: rados mon op timeout = 15m 2020-11-20T12:13:22.626 INFO:teuthology.orchestra.run.smithi160.stdout: rados osd op timeout = 15m 2020-11-20T12:13:22.639 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T12:13:22.640 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T12:13:22.764 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T12:13:22.765 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:22.765 INFO:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T12:13:22.803 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T12:13:22.805 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.] 2020-11-20T12:13:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDisrdf18tRCBAAnqIiTz4N/WDl62w7WxnhlA== 2020-11-20T12:13:22.805 INFO:teuthology.orchestra.run.smithi160.stdout:[client.admin] 2020-11-20T12:13:22.805 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDisrdfiicVLRAA6u3W8/AA3tUn8R1M2Lg5vA== 2020-11-20T12:13:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: caps mds = "allow *" 2020-11-20T12:13:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: caps mgr = "allow *" 2020-11-20T12:13:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: caps mon = "allow *" 2020-11-20T12:13:22.806 INFO:teuthology.orchestra.run.smithi160.stdout: caps osd = "allow *" 2020-11-20T12:13:22.807 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:22.807 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:22.807 INFO:teuthology.orchestra.run.smithi160.stderr:206 bytes copied, 9.6478e-05 s, 2.1 MB/s 2020-11-20T12:13:22.807 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:22.808 INFO:teuthology.orchestra.run.smithi160:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T12:13:22.883 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T12:13:22.885 INFO:teuthology.orchestra.run.smithi160.stdout: ���oCFDd����I�Zâ²·_p�â²·_p��aXa �����bXb �����cXc �����abc 2020-11-20T12:13:22.885 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:22.886 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:22.886 INFO:teuthology.orchestra.run.smithi160.stderr:409 bytes copied, 0.000106046 s, 3.9 MB/s 2020-11-20T12:13:22.886 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:13:22.887 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:22.887 INFO:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:22.887 INFO:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:22.926 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:22.960 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:22.960 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:22.961 INFO:teuthology.orchestra.run.smithi160.stderr:206 bytes copied, 0.00014751 s, 1.4 MB/s 2020-11-20T12:13:22.963 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:23.009 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:23.009 INFO:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:23.092 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:23.095 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:23.095 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:23.095 INFO:teuthology.orchestra.run.smithi160.stderr:409 bytes copied, 0.000164355 s, 2.5 MB/s 2020-11-20T12:13:23.096 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:13:23.096 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:23.097 INFO:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:23.097 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:23.113 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:23.128 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:23.129 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:23.129 INFO:teuthology.orchestra.run.smithi150.stderr:206 bytes copied, 3.5744e-05 s, 5.8 MB/s 2020-11-20T12:13:23.129 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:23.145 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:23.145 INFO:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:23.200 INFO:teuthology.orchestra.run.smithi150.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:23.201 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:23.202 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:23.202 INFO:teuthology.orchestra.run.smithi150.stderr:409 bytes copied, 3.4219e-05 s, 12.0 MB/s 2020-11-20T12:13:23.202 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:13:23.203 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:23.203 INFO:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:23.203 INFO:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:23.219 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:23.234 INFO:teuthology.orchestra.run.smithi134.stderr:206 bytes copied, 3.7031e-05 s, 5.6 MB/s 2020-11-20T12:13:23.235 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:23.250 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:23.250 INFO:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:23.304 INFO:teuthology.orchestra.run.smithi134.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:23.305 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:23.306 INFO:teuthology.orchestra.run.smithi134.stderr:409 bytes copied, 3.1151e-05 s, 13.1 MB/s 2020-11-20T12:13:23.306 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T12:13:23.306 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T12:13:23.307 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T12:13:23.452 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T12:13:23.458 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T12:13:23.531 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T12:13:23.533 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T12:13:23.614 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T12:13:23.616 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T12:13:23.617 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T12:13:23.756 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T12:13:23.761 INFO:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T12:13:23.839 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T12:13:23.900 INFO:teuthology.orchestra.run.smithi150.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T12:13:23.903 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T12:13:23.932 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T12:13:23.993 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T12:13:23.995 INFO:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-11-20T12:13:24.024 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T12:13:24.025 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T12:13:24.134 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T12:13:24.177 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T12:13:24.177 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi150.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T12:13:24.178 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:24.255 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:24.256 INFO:tasks.ceph:role: osd.0 2020-11-20T12:13:24.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:13:24.256 INFO:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T12:13:24.806 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:24.807 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:24.807 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:24.807 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2020-11-20T12:13:24.808 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:24.808 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:24.808 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:24.808 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:24.808 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:24.809 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:24.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2020-11-20T12:13:24.818 INFO:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:25.023 INFO:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:25.125 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:25.213 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:25.214 INFO:tasks.ceph:role: osd.3 2020-11-20T12:13:25.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:13:25.215 INFO:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T12:13:25.739 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:25.740 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:25.740 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:25.741 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2020-11-20T12:13:25.741 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:25.741 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:25.742 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:25.742 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:25.742 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:25.743 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:25.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2020-11-20T12:13:25.749 INFO:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:25.938 INFO:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:26.050 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:26.151 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:26.152 INFO:tasks.ceph:role: osd.6 2020-11-20T12:13:26.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:13:26.153 INFO:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T12:13:26.738 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:26.738 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:26.738 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:26.739 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2020-11-20T12:13:26.739 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:26.739 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:26.739 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:26.739 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:26.740 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:26.740 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:26.745 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2020-11-20T12:13:26.745 INFO:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:26.951 INFO:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:27.088 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:27.214 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:27.214 INFO:tasks.ceph:role: osd.9 2020-11-20T12:13:27.215 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:13:27.215 INFO:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T12:13:27.764 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:27.765 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:27.765 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:27.765 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 2020-11-20T12:13:27.765 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:27.765 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:27.766 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:27.766 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:27.766 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:27.766 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:27.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2020-11-20T12:13:27.773 INFO:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:27.937 INFO:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:28.067 INFO:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:28.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.231+0000 7fd8f3bd5ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T12:13:28.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.232+0000 7fd8f3bd5ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T12:13:28.275 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.272+0000 7fd8f3bd5ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:28.275 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.272+0000 7fd8f3bd5ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:28.551 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.547+0000 7fd8f3bd5ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:28.552 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.549+0000 7fd8f3bd5ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:28.552 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.549+0000 7fd8f3bd5ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:28.586 INFO:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:28.681 INFO:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:28.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.899+0000 7f1acce64ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T12:13:28.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.902+0000 7f1acce64ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T12:13:28.937 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.934+0000 7f1acce64ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:28.938 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:28.934+0000 7f1acce64ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:29.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.096+0000 7f1acce64ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:29.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.096+0000 7f1acce64ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:29.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.096+0000 7f1acce64ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:29.120 INFO:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:29.245 INFO:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:29.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.393+0000 7f1276553ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T12:13:29.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.394+0000 7f1276553ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T12:13:29.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.407+0000 7f1276553ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:29.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.407+0000 7f1276553ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:29.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.549+0000 7f1276553ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:29.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.550+0000 7f1276553ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:29.554 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.550+0000 7f1276553ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:29.576 INFO:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:29.674 INFO:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:29.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.809+0000 7f161909bec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2020-11-20T12:13:29.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.809+0000 7f161909bec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2020-11-20T12:13:29.829 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.825+0000 7f161909bec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:29.829 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.825+0000 7f161909bec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:29.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.980+0000 7f161909bec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:29.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.981+0000 7f161909bec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:29.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:29.981+0000 7f161909bec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:30.013 INFO:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:30.113 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:30.474 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:30.475 INFO:tasks.ceph:role: osd.1 2020-11-20T12:13:30.475 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:13:30.475 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T12:13:31.039 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:31.040 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-11-20T12:13:31.040 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:31.041 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:31.041 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:31.041 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:31.041 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:31.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-11-20T12:13:31.043 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:31.161 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:31.199 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:31.268 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:31.268 INFO:tasks.ceph:role: osd.4 2020-11-20T12:13:31.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:13:31.269 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T12:13:31.782 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:31.783 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:31.783 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:31.783 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-11-20T12:13:31.783 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:31.784 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:31.784 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:31.784 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:31.784 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:31.784 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:31.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-11-20T12:13:31.786 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:31.831 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:31.863 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:31.930 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:31.930 INFO:tasks.ceph:role: osd.7 2020-11-20T12:13:31.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:13:31.931 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T12:13:32.461 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:32.461 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:32.462 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:32.462 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-11-20T12:13:32.462 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:32.462 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:32.462 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:32.463 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:32.463 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:32.463 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:32.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-11-20T12:13:32.464 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:32.538 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:32.569 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:32.637 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:32.638 INFO:tasks.ceph:role: osd.10 2020-11-20T12:13:32.638 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:13:32.639 INFO:teuthology.orchestra.run.smithi150:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T12:13:33.174 INFO:teuthology.orchestra.run.smithi150.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:33.174 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: = reflink=1 2020-11-20T12:13:33.175 INFO:teuthology.orchestra.run.smithi150.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:33.175 INFO:teuthology.orchestra.run.smithi150.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:33.176 INFO:teuthology.orchestra.run.smithi150.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:33.176 INFO:teuthology.orchestra.run.smithi150.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:33.176 INFO:teuthology.orchestra.run.smithi150.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:33.176 INFO:teuthology.orchestra.run.smithi150.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:33.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi150.front.sepia.ceph.com -o noatime 2020-11-20T12:13:33.178 INFO:teuthology.orchestra.run.smithi150:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:33.273 INFO:teuthology.orchestra.run.smithi150:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:33.305 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:33.388 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.385+0000 7f7e4bec1ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T12:13:33.391 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.387+0000 7f7e4bec1ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T12:13:33.413 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.409+0000 7f7e4bec1ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:33.415 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.411+0000 7f7e4bec1ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:33.655 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.651+0000 7f7e4bec1ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:33.656 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.652+0000 7f7e4bec1ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:33.656 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.652+0000 7f7e4bec1ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:33.672 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:33.700 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:33.784 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.780+0000 7f74754bcec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T12:13:33.785 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.781+0000 7f74754bcec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T12:13:33.812 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.809+0000 7f74754bcec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:33.815 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:33.812+0000 7f74754bcec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:34.062 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.058+0000 7f74754bcec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:34.062 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.058+0000 7f74754bcec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:34.062 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.058+0000 7f74754bcec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:34.078 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:34.145 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:34.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.224+0000 7f81a59fbec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T12:13:34.228 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.224+0000 7f81a59fbec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T12:13:34.236 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.232+0000 7f81a59fbec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:34.236 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.232+0000 7f81a59fbec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:34.363 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.359+0000 7f81a59fbec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:34.363 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.359+0000 7f81a59fbec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:34.364 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.359+0000 7f81a59fbec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:34.370 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:34.444 INFO:teuthology.orchestra.run.smithi150:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:34.529 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.525+0000 7fdc94f0eec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-11-20T12:13:34.530 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.525+0000 7fdc94f0eec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2020-11-20T12:13:34.534 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.530+0000 7fdc94f0eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:34.534 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.530+0000 7fdc94f0eec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.656+0000 7fdc94f0eec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.657+0000 7fdc94f0eec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:34.661 INFO:teuthology.orchestra.run.smithi150.stderr:2020-11-20T12:13:34.657+0000 7fdc94f0eec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:34.669 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:34.745 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:34.781 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:34.782 INFO:tasks.ceph:role: osd.2 2020-11-20T12:13:34.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:13:34.783 INFO:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T12:13:35.304 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:35.304 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2020-11-20T12:13:35.305 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:35.305 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:35.305 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:35.305 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:35.306 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:35.306 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:35.307 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2020-11-20T12:13:35.307 INFO:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:35.419 INFO:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:35.452 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T12:13:35.520 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:35.521 INFO:tasks.ceph:role: osd.5 2020-11-20T12:13:35.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:13:35.522 INFO:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T12:13:36.049 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:36.846 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2020-11-20T12:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:36.847 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:36.848 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:36.848 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:36.848 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:36.849 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2020-11-20T12:13:36.849 INFO:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T12:13:36.900 INFO:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T12:13:36.936 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2020-11-20T12:13:37.009 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:37.010 INFO:tasks.ceph:role: osd.8 2020-11-20T12:13:37.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:13:37.010 INFO:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T12:13:37.547 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:37.547 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:37.548 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:37.548 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2020-11-20T12:13:37.548 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:37.548 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:37.548 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:37.549 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:37.549 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:37.549 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:37.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2020-11-20T12:13:37.550 INFO:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2020-11-20T12:13:37.623 INFO:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2020-11-20T12:13:37.662 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2020-11-20T12:13:37.740 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:37.741 INFO:tasks.ceph:role: osd.11 2020-11-20T12:13:37.741 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:13:37.741 INFO:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T12:13:38.288 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:38.288 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:38.289 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:38.289 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2020-11-20T12:13:38.289 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:38.289 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:38.290 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:38.290 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:38.290 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:38.290 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:38.291 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2020-11-20T12:13:38.292 INFO:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2020-11-20T12:13:38.406 INFO:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2020-11-20T12:13:38.438 INFO:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:38.525 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.522+0000 7fe26ddecec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T12:13:38.529 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.526+0000 7fe26ddecec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T12:13:38.548 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.545+0000 7fe26ddecec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:38.550 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.548+0000 7fe26ddecec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:38.791 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.788+0000 7fe26ddecec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:38.793 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.790+0000 7fe26ddecec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:38.793 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.790+0000 7fe26ddecec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:38.810 INFO:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:38.839 INFO:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:38.923 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.920+0000 7f3eb7fdaec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T12:13:38.924 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.921+0000 7f3eb7fdaec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T12:13:38.953 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.950+0000 7f3eb7fdaec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:38.955 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:38.952+0000 7f3eb7fdaec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:39.175 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.172+0000 7f3eb7fdaec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:39.176 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.172+0000 7f3eb7fdaec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:39.176 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.172+0000 7f3eb7fdaec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:39.181 INFO:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T12:13:39.249 INFO:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:39.333 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.330+0000 7f98e9838ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2020-11-20T12:13:39.334 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.330+0000 7f98e9838ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2020-11-20T12:13:39.340 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.337+0000 7f98e9838ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:39.340 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.337+0000 7f98e9838ec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:39.469 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.466+0000 7f98e9838ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:39.469 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.466+0000 7f98e9838ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:39.470 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.466+0000 7f98e9838ec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:39.475 INFO:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-20T12:13:39.542 INFO:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:39.625 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.622+0000 7f0e4791aec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2020-11-20T12:13:39.626 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.622+0000 7f0e4791aec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2020-11-20T12:13:39.630 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.627+0000 7f0e4791aec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:39.630 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.627+0000 7f0e4791aec0 -1 journal FileJournal::_open_file : zeroing journal 2020-11-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.753+0000 7f0e4791aec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.754+0000 7f0e4791aec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:39.757 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:39.754+0000 7f0e4791aec0 -1 journal do_read_entry(4096): bad header magic 2020-11-20T12:13:39.765 INFO:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-20T12:13:39.832 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T12:13:39.833 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:39.833 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T12:13:39.889 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T12:13:39.935 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2020-11-20T12:13:39.936 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdfuA3OGhAASyJ+8xV/uH9LBe7IxXby3g== 2020-11-20T12:13:39.936 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:39.936 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:39.937 INFO:teuthology.orchestra.run.smithi160.stderr:56 bytes copied, 0.000277774 s, 202 kB/s 2020-11-20T12:13:39.939 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:39.939 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T12:13:39.990 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T12:13:40.035 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2020-11-20T12:13:40.036 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdfRpjyLBAAqhODVTrgbkh9vwxf2pwmlQ== 2020-11-20T12:13:40.036 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:40.037 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:40.037 INFO:teuthology.orchestra.run.smithi160.stderr:56 bytes copied, 0.000179486 s, 312 kB/s 2020-11-20T12:13:40.039 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:40.040 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T12:13:40.090 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T12:13:40.135 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2020-11-20T12:13:40.136 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDosrdfisDXDRAAdyByNaTN14STlr5Qeefk9A== 2020-11-20T12:13:40.136 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:40.136 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:40.137 INFO:teuthology.orchestra.run.smithi160.stderr:56 bytes copied, 0.000142193 s, 394 kB/s 2020-11-20T12:13:40.139 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:40.140 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T12:13:40.192 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T12:13:40.239 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2020-11-20T12:13:40.240 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDosrdfpwqwNRAAt3xw+wIRQwsfIJ0V0Etg5g== 2020-11-20T12:13:40.240 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:40.240 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:40.240 INFO:teuthology.orchestra.run.smithi160.stderr:56 bytes copied, 0.000115788 s, 484 kB/s 2020-11-20T12:13:40.245 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:40.245 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T12:13:40.295 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T12:13:40.337 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2020-11-20T12:13:40.338 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDpsrdfVHiGFxAAS2qScHw2qd5L0cyxeKej/A== 2020-11-20T12:13:40.338 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:40.338 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:40.339 INFO:teuthology.orchestra.run.smithi160.stderr:56 bytes copied, 0.000120971 s, 463 kB/s 2020-11-20T12:13:40.341 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:40.341 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T12:13:40.433 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T12:13:40.480 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.9] 2020-11-20T12:13:40.481 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDpsrdf95hNMBAAyJJbYeLh/DN0jTwfOXH0hQ== 2020-11-20T12:13:40.481 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:40.481 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:40.482 INFO:teuthology.orchestra.run.smithi160.stderr:56 bytes copied, 0.000114123 s, 491 kB/s 2020-11-20T12:13:40.485 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:40.485 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T12:13:40.501 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T12:13:40.516 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2020-11-20T12:13:40.517 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdf9X6QHxAAuVJKwKaZZxLk/fOsz2Fekw== 2020-11-20T12:13:40.517 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:40.518 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:40.518 INFO:teuthology.orchestra.run.smithi150.stderr:56 bytes copied, 4.7571e-05 s, 1.2 MB/s 2020-11-20T12:13:40.519 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:40.519 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T12:13:40.574 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T12:13:40.588 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2020-11-20T12:13:40.589 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdf032QNRAACyym16ze1P1VBWBx61ofEQ== 2020-11-20T12:13:40.589 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:40.589 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:40.590 INFO:teuthology.orchestra.run.smithi150.stderr:56 bytes copied, 5.8715e-05 s, 954 kB/s 2020-11-20T12:13:40.591 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:40.591 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T12:13:40.645 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T12:13:40.659 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2020-11-20T12:13:40.659 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtsrdf9mgMFxAAzIxzZEK/vdTocJdvW0TEdw== 2020-11-20T12:13:40.660 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:40.660 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:40.660 INFO:teuthology.orchestra.run.smithi150.stderr:56 bytes copied, 4.7849e-05 s, 1.2 MB/s 2020-11-20T12:13:40.661 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:40.662 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T12:13:40.716 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T12:13:40.731 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2020-11-20T12:13:40.731 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtsrdfWZaeLhAAkt0S7MC4b2uG+XEXUoGVZg== 2020-11-20T12:13:40.732 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:40.735 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:40.737 INFO:teuthology.orchestra.run.smithi150.stderr:56 bytes copied, 3.2309e-05 s, 1.7 MB/s 2020-11-20T12:13:40.743 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:40.745 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T12:13:40.806 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T12:13:40.820 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2020-11-20T12:13:40.821 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDusrdf/ed4DRAA4W+sAlwrBl8ovWDOF/eEag== 2020-11-20T12:13:40.821 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:40.821 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:40.822 INFO:teuthology.orchestra.run.smithi150.stderr:56 bytes copied, 3.8622e-05 s, 1.4 MB/s 2020-11-20T12:13:40.823 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:40.824 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T12:13:40.888 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T12:13:40.903 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.10] 2020-11-20T12:13:40.904 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDusrdfGjhtHxAAs2oaL4uk3cPUcrfjUkGs0A== 2020-11-20T12:13:40.904 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:40.905 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:40.907 INFO:teuthology.orchestra.run.smithi150.stderr:57 bytes copied, 2.9388e-05 s, 1.9 MB/s 2020-11-20T12:13:40.908 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:40.909 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T12:13:40.927 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T12:13:40.942 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.z] 2020-11-20T12:13:40.943 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdf2nB6JBAAFpIndbndHCFloxkk2XPGrA== 2020-11-20T12:13:40.943 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:40.944 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:40.945 INFO:teuthology.orchestra.run.smithi134.stderr:56 bytes copied, 5.0719e-05 s, 1.1 MB/s 2020-11-20T12:13:40.946 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:40.946 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T12:13:41.003 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T12:13:41.018 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2020-11-20T12:13:41.018 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdf36ISOxAA0JO8GNpwUluM+B2tv5Lkig== 2020-11-20T12:13:41.019 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:41.019 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:41.020 INFO:teuthology.orchestra.run.smithi134.stderr:56 bytes copied, 5.8566e-05 s, 956 kB/s 2020-11-20T12:13:41.020 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:41.021 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T12:13:41.074 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T12:13:41.087 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2020-11-20T12:13:41.088 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDysrdfEqQ2HxAAOTXMImRmEXBFGmUxWGpJgQ== 2020-11-20T12:13:41.088 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:41.088 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:41.089 INFO:teuthology.orchestra.run.smithi134.stderr:56 bytes copied, 3.2911e-05 s, 1.7 MB/s 2020-11-20T12:13:41.090 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:41.090 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T12:13:41.144 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T12:13:41.157 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2020-11-20T12:13:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDysrdf5uTqNhAASkA8pPOjs7hjRNG3espfAg== 2020-11-20T12:13:41.158 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:41.158 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:41.158 INFO:teuthology.orchestra.run.smithi134.stderr:56 bytes copied, 3.2117e-05 s, 1.7 MB/s 2020-11-20T12:13:41.160 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:41.160 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T12:13:41.214 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T12:13:41.227 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.8] 2020-11-20T12:13:41.227 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDzsrdfRVjEExAAZc744/Ta/RHhlhSZ3C/CjA== 2020-11-20T12:13:41.228 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:41.228 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:41.228 INFO:teuthology.orchestra.run.smithi134.stderr:56 bytes copied, 3.1857e-05 s, 1.8 MB/s 2020-11-20T12:13:41.229 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:41.229 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T12:13:41.282 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T12:13:41.296 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.11] 2020-11-20T12:13:41.296 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDzsrdfOoQoJRAAZC+RjDcTMV6l3TobRtxAZQ== 2020-11-20T12:13:41.296 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:41.296 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:41.297 INFO:teuthology.orchestra.run.smithi134.stderr:57 bytes copied, 3.2873e-05 s, 1.7 MB/s 2020-11-20T12:13:41.298 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:41.298 INFO:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T12:13:41.355 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T12:13:41.357 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2020-11-20T12:13:41.357 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDksrdfX57pBxAAZCnTarcyIO3WxwSO2bPbXA== 2020-11-20T12:13:41.357 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:41.357 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:41.358 INFO:teuthology.orchestra.run.smithi160.stderr:59 bytes copied, 0.000133472 s, 442 kB/s 2020-11-20T12:13:41.358 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T12:13:41.359 INFO:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T12:13:41.361 INFO:teuthology.orchestra.run.smithi150:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T12:13:41.365 INFO:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T12:13:41.386 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2020-11-20T12:13:41.386 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdfuA3OGhAASyJ+8xV/uH9LBe7IxXby3g== 2020-11-20T12:13:41.386 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2020-11-20T12:13:41.386 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdfRpjyLBAAqhODVTrgbkh9vwxf2pwmlQ== 2020-11-20T12:13:41.387 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2020-11-20T12:13:41.387 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDosrdfisDXDRAAdyByNaTN14STlr5Qeefk9A== 2020-11-20T12:13:41.387 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.3] 2020-11-20T12:13:41.387 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDosrdfpwqwNRAAt3xw+wIRQwsfIJ0V0Etg5g== 2020-11-20T12:13:41.387 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.6] 2020-11-20T12:13:41.388 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDpsrdfVHiGFxAAS2qScHw2qd5L0cyxeKej/A== 2020-11-20T12:13:41.388 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.9] 2020-11-20T12:13:41.388 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDpsrdf95hNMBAAyJJbYeLh/DN0jTwfOXH0hQ== 2020-11-20T12:13:41.388 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.y] 2020-11-20T12:13:41.388 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdf9X6QHxAAuVJKwKaZZxLk/fOsz2Fekw== 2020-11-20T12:13:41.389 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.b] 2020-11-20T12:13:41.389 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdf032QNRAACyym16ze1P1VBWBx61ofEQ== 2020-11-20T12:13:41.389 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2020-11-20T12:13:41.389 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDtsrdf9mgMFxAAzIxzZEK/vdTocJdvW0TEdw== 2020-11-20T12:13:41.390 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.4] 2020-11-20T12:13:41.390 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDtsrdfWZaeLhAAkt0S7MC4b2uG+XEXUoGVZg== 2020-11-20T12:13:41.390 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.7] 2020-11-20T12:13:41.390 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDusrdf/ed4DRAA4W+sAlwrBl8ovWDOF/eEag== 2020-11-20T12:13:41.390 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.10] 2020-11-20T12:13:41.391 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDusrdfGjhtHxAAs2oaL4uk3cPUcrfjUkGs0A== 2020-11-20T12:13:41.391 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.z] 2020-11-20T12:13:41.391 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdf2nB6JBAAFpIndbndHCFloxkk2XPGrA== 2020-11-20T12:13:41.391 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.c] 2020-11-20T12:13:41.391 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDjsrdf36ISOxAA0JO8GNpwUluM+B2tv5Lkig== 2020-11-20T12:13:41.392 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2020-11-20T12:13:41.392 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDysrdfEqQ2HxAAOTXMImRmEXBFGmUxWGpJgQ== 2020-11-20T12:13:41.392 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.5] 2020-11-20T12:13:41.392 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDysrdf5uTqNhAASkA8pPOjs7hjRNG3espfAg== 2020-11-20T12:13:41.392 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.8] 2020-11-20T12:13:41.393 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDzsrdfRVjEExAAZc744/Ta/RHhlhSZ3C/CjA== 2020-11-20T12:13:41.393 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.11] 2020-11-20T12:13:41.393 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDzsrdfOoQoJRAAZC+RjDcTMV6l3TobRtxAZQ== 2020-11-20T12:13:41.394 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2020-11-20T12:13:41.394 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQDksrdfX57pBxAAZCnTarcyIO3WxwSO2bPbXA== 2020-11-20T12:13:41.395 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.x] 2020-11-20T12:13:41.395 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdfuA3OGhAASyJ+8xV/uH9LBe7IxXby3g== 2020-11-20T12:13:41.395 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2020-11-20T12:13:41.396 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdfRpjyLBAAqhODVTrgbkh9vwxf2pwmlQ== 2020-11-20T12:13:41.396 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.0] 2020-11-20T12:13:41.396 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDosrdfisDXDRAAdyByNaTN14STlr5Qeefk9A== 2020-11-20T12:13:41.396 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.3] 2020-11-20T12:13:41.396 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDosrdfpwqwNRAAt3xw+wIRQwsfIJ0V0Etg5g== 2020-11-20T12:13:41.397 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.6] 2020-11-20T12:13:41.397 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDpsrdfVHiGFxAAS2qScHw2qd5L0cyxeKej/A== 2020-11-20T12:13:41.397 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.9] 2020-11-20T12:13:41.397 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDpsrdf95hNMBAAyJJbYeLh/DN0jTwfOXH0hQ== 2020-11-20T12:13:41.398 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.y] 2020-11-20T12:13:41.398 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdf9X6QHxAAuVJKwKaZZxLk/fOsz2Fekw== 2020-11-20T12:13:41.398 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2020-11-20T12:13:41.398 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdf032QNRAACyym16ze1P1VBWBx61ofEQ== 2020-11-20T12:13:41.398 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.1] 2020-11-20T12:13:41.399 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtsrdf9mgMFxAAzIxzZEK/vdTocJdvW0TEdw== 2020-11-20T12:13:41.399 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.4] 2020-11-20T12:13:41.399 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDtsrdfWZaeLhAAkt0S7MC4b2uG+XEXUoGVZg== 2020-11-20T12:13:41.399 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.7] 2020-11-20T12:13:41.399 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDusrdf/ed4DRAA4W+sAlwrBl8ovWDOF/eEag== 2020-11-20T12:13:41.400 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.10] 2020-11-20T12:13:41.400 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDusrdfGjhtHxAAs2oaL4uk3cPUcrfjUkGs0A== 2020-11-20T12:13:41.400 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr.z] 2020-11-20T12:13:41.400 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdf2nB6JBAAFpIndbndHCFloxkk2XPGrA== 2020-11-20T12:13:41.400 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2020-11-20T12:13:41.401 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDjsrdf36ISOxAA0JO8GNpwUluM+B2tv5Lkig== 2020-11-20T12:13:41.401 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.2] 2020-11-20T12:13:41.401 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDysrdfEqQ2HxAAOTXMImRmEXBFGmUxWGpJgQ== 2020-11-20T12:13:41.401 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.5] 2020-11-20T12:13:41.401 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDysrdf5uTqNhAASkA8pPOjs7hjRNG3espfAg== 2020-11-20T12:13:41.402 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.8] 2020-11-20T12:13:41.402 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDzsrdfRVjEExAAZc744/Ta/RHhlhSZ3C/CjA== 2020-11-20T12:13:41.402 INFO:teuthology.orchestra.run.smithi150.stdout:[osd.11] 2020-11-20T12:13:41.402 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDzsrdfOoQoJRAAZC+RjDcTMV6l3TobRtxAZQ== 2020-11-20T12:13:41.402 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2020-11-20T12:13:41.402 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQDksrdfX57pBxAAZCnTarcyIO3WxwSO2bPbXA== 2020-11-20T12:13:41.466 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2020-11-20T12:13:41.467 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdfuA3OGhAASyJ+8xV/uH9LBe7IxXby3g== 2020-11-20T12:13:41.467 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2020-11-20T12:13:41.467 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdfRpjyLBAAqhODVTrgbkh9vwxf2pwmlQ== 2020-11-20T12:13:41.467 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2020-11-20T12:13:41.467 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDosrdfisDXDRAAdyByNaTN14STlr5Qeefk9A== 2020-11-20T12:13:41.468 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2020-11-20T12:13:41.468 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDosrdfpwqwNRAAt3xw+wIRQwsfIJ0V0Etg5g== 2020-11-20T12:13:41.468 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2020-11-20T12:13:41.468 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDpsrdfVHiGFxAAS2qScHw2qd5L0cyxeKej/A== 2020-11-20T12:13:41.468 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.9] 2020-11-20T12:13:41.469 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDpsrdf95hNMBAAyJJbYeLh/DN0jTwfOXH0hQ== 2020-11-20T12:13:41.469 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2020-11-20T12:13:41.469 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdf9X6QHxAAuVJKwKaZZxLk/fOsz2Fekw== 2020-11-20T12:13:41.469 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2020-11-20T12:13:41.469 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdf032QNRAACyym16ze1P1VBWBx61ofEQ== 2020-11-20T12:13:41.470 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2020-11-20T12:13:41.470 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDtsrdf9mgMFxAAzIxzZEK/vdTocJdvW0TEdw== 2020-11-20T12:13:41.470 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2020-11-20T12:13:41.470 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDtsrdfWZaeLhAAkt0S7MC4b2uG+XEXUoGVZg== 2020-11-20T12:13:41.470 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2020-11-20T12:13:41.471 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDusrdf/ed4DRAA4W+sAlwrBl8ovWDOF/eEag== 2020-11-20T12:13:41.471 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.10] 2020-11-20T12:13:41.471 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDusrdfGjhtHxAAs2oaL4uk3cPUcrfjUkGs0A== 2020-11-20T12:13:41.471 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.z] 2020-11-20T12:13:41.471 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdf2nB6JBAAFpIndbndHCFloxkk2XPGrA== 2020-11-20T12:13:41.472 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2020-11-20T12:13:41.472 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDjsrdf36ISOxAA0JO8GNpwUluM+B2tv5Lkig== 2020-11-20T12:13:41.472 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2020-11-20T12:13:41.472 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDysrdfEqQ2HxAAOTXMImRmEXBFGmUxWGpJgQ== 2020-11-20T12:13:41.472 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2020-11-20T12:13:41.473 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDysrdf5uTqNhAASkA8pPOjs7hjRNG3espfAg== 2020-11-20T12:13:41.473 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.8] 2020-11-20T12:13:41.473 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDzsrdfRVjEExAAZc744/Ta/RHhlhSZ3C/CjA== 2020-11-20T12:13:41.473 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.11] 2020-11-20T12:13:41.473 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDzsrdfOoQoJRAAZC+RjDcTMV6l3TobRtxAZQ== 2020-11-20T12:13:41.474 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2020-11-20T12:13:41.474 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQDksrdfX57pBxAAZCnTarcyIO3WxwSO2bPbXA== 2020-11-20T12:13:41.475 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:41.478 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:41.558 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:41.729 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:41.733 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:41.740 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:41.891 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:41.895 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:41.902 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.050 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.058 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.067 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.221 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.228 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.234 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.380 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.384 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.391 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.538 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:42.544 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:42.547 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:42.692 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:42.701 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:42.711 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:42.865 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.872 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:42.885 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.033 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.037 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.045 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.193 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.200 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.207 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.368 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.374 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.379 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.527 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:43.532 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:43.535 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:13:43.683 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:43.686 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:43.688 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:13:43.827 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.830 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.832 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.972 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.974 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:43.976 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:44.117 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:44.119 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:44.121 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:44.258 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:44.260 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:44.262 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:13:44.399 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T12:13:44.401 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T12:13:44.403 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T12:13:44.547 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T12:13:44.547 INFO:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T12:13:44.644 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T12:13:44.803 INFO:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T12:13:44.901 INFO:teuthology.orchestra.run.smithi150:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T12:13:44.929 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T12:13:45.026 INFO:teuthology.orchestra.run.smithi150:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T12:13:45.054 INFO:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T12:13:45.084 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T12:13:45.183 INFO:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T12:13:45.210 INFO:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:45.252 INFO:teuthology.orchestra.run.smithi150:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:45.254 INFO:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:45.314 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T12:13:45.314 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T12:13:45.315 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T12:13:45.320 INFO:tasks.ceph.mon.a:Started 2020-11-20T12:13:45.320 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T12:13:45.321 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T12:13:45.323 INFO:tasks.ceph.mon.b:Started 2020-11-20T12:13:45.323 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T12:13:45.323 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T12:13:45.326 INFO:tasks.ceph.mon.c:Started 2020-11-20T12:13:45.326 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T12:13:45.326 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T12:13:45.327 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T12:13:45.331 INFO:tasks.ceph.mgr.x:Started 2020-11-20T12:13:45.332 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T12:13:45.332 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T12:13:45.334 INFO:tasks.ceph.mgr.y:Started 2020-11-20T12:13:45.334 INFO:tasks.ceph.mgr.z:Restarting daemon 2020-11-20T12:13:45.335 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2020-11-20T12:13:45.337 INFO:tasks.ceph.mgr.z:Started 2020-11-20T12:13:45.337 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T12:13:45.337 INFO:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T12:13:45.551 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.548+0000 7f8653fff700 1 Processor -- start 2020-11-20T12:13:45.552 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.548+0000 7f8653fff700 1 -- start start 2020-11-20T12:13:45.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.549+0000 7f8653fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:45.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.549+0000 7f8653fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:45.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f8653fff700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540bbd40 con 0x7f86540639b0 2020-11-20T12:13:45.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f8653fff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86540bbfe0 con 0x7f8654063d90 2020-11-20T12:13:45.554 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f8653fff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86540667b0 con 0x7f8654150520 2020-11-20T12:13:45.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f8652ffd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f86540639b0 0x7f8654067430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:59404/0 (socket says 172.21.15.160:59404) 2020-11-20T12:13:45.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f8652ffd700 1 -- 172.21.15.160:0/2838883413 learned_addr learned my addr 172.21.15.160:0/2838883413 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:13:45.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:45.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T12:13:45.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:45.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:45.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T12:13:45.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.550+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:45.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.551+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:13:45.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.551+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:45.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.551+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:45.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.551+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T12:13:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.751+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.751+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T12:13:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.751+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.751+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.751+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T12:13:45.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.752+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:45.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.753+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T12:13:45.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.753+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:45.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.753+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:45.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:45.753+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T12:13:46.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.153+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:46.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.153+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T12:13:46.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.153+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:46.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.153+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:46.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.153+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T12:13:46.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.154+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:46.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.155+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T12:13:46.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.155+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:46.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.155+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:46.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.155+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T12:13:46.958 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.955+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:46.959 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.955+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T12:13:46.959 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.955+0000 7f86527fc700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:46.959 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.955+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:46.960 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.955+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T12:13:46.961 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.956+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:46.961 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.957+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-11-20T12:13:46.962 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.957+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:46.962 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.957+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:46.962 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:46.957+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T12:13:48.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 msgr2=0x7f86541509b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T12:13:48.554 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.160:3300/0 conn(0x7f8654150520 0x7f86541509b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:48.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 msgr2=0x7f8654067b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T12:13:48.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.134:3300/0 conn(0x7f8654063d90 0x7f8654067b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:48.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 -- 172.21.15.160:0/2838883413 >> v1:172.21.15.134:6789/0 conn(0x7f86540639b0 legacy=0x7f8654067430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:48.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:48.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 -- 172.21.15.160:0/2838883413 --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8654066a50 con 0x7f86340070a0 2020-11-20T12:13:48.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 -- 172.21.15.160:0/2838883413 --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863400e980 con 0x7f8634003390 2020-11-20T12:13:48.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.550+0000 7f8650ff9700 1 -- 172.21.15.160:0/2838883413 --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86540bbfe0 con 0x7f863400ae00 2020-11-20T12:13:48.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.551+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:48.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.551+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:13:48.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.551+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:48.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.551+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:48.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.551+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T12:13:48.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.752+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:48.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.753+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:13:48.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.753+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:48.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.753+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:48.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:48.753+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T12:13:49.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.154+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:49.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.154+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:13:49.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.154+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:49.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.154+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:49.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.155+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T12:13:49.960 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.956+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:49.960 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.956+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:13:49.960 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.956+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:13:49.961 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.956+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:13:49.961 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:49.956+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T12:13:50.477 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:50.487 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:50.499 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:50.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.699+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680571679 0 0) 0x7f8654066a50 con 0x7f86340070a0 2020-11-20T12:13:50.729 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.699+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8640003240 con 0x7f86340070a0 2020-11-20T12:13:50.738 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.701+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126933863 0 0) 0x7f863400e980 con 0x7f8634003390 2020-11-20T12:13:50.738 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.701+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8654066a50 con 0x7f8634003390 2020-11-20T12:13:50.739 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.704+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 <== mon.2 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2805370643 0 0) 0x7f8654066a50 con 0x7f8634003390 2020-11-20T12:13:50.739 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.704+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 msgr2=0x7f863400d2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T12:13:50.739 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.704+0000 7f8651ffb700 1 --2- 172.21.15.160:0/2838883413 >> v2:172.21.15.150:3300/0 conn(0x7f863400ae00 0x7f863400d2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.740 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.705+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 >> v1:172.21.15.150:6789/0 conn(0x7f86340070a0 legacy=0x7f8634009540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:50.740 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.705+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863400fc60 con 0x7f8634003390 2020-11-20T12:13:50.740 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.705+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 <== mon.2 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f8644001520 con 0x7f8634003390 2020-11-20T12:13:50.741 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.705+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 >> v1:172.21.15.160:6789/0 conn(0x7f8634003390 legacy=0x7f86340057e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:50.741 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.705+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 reap_dead start 2020-11-20T12:13:50.741 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.706+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 reap_dead start 2020-11-20T12:13:50.742 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.706+0000 7f8651ffb700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f8640003ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:50.742 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.706+0000 7f8651ffb700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86400044e0 0x7f8640004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:50.742 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.706+0000 7f8651ffb700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8640004e50 0x7f864000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:50.742 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.706+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540bbfe0 con 0x7f86400044e0 2020-11-20T12:13:50.743 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.706+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864000bc20 con 0x7f8640004e50 2020-11-20T12:13:50.743 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.706+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864000bd90 con 0x7f86400038c0 2020-11-20T12:13:50.743 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.707+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8640004e50 0x7f864000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:50.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.707+0000 7f8652ffd700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f8640003ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:50.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.707+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86400044e0 0x7f8640004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:50.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.708+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 msgr2=0x7f8640003ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:50.745 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.708+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f8640003ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.745 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.708+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86400044e0 msgr2=0x7f8640004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:50.745 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.708+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86400044e0 0x7f8640004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.746 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.708+0000 7f86537fe700 1 -- 172.21.15.160:0/2838883413 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654066a50 con 0x7f8640004e50 2020-11-20T12:13:50.746 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.708+0000 7f86527fc700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86400044e0 0x7f8640004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:50.746 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.709+0000 7f86537fe700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8640004e50 0x7f864000b730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f863400d870 tx=0x7f864c008040).ready entity=mon.1 client_cookie=512626a07acca5bb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:50.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.710+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c01e070 con 0x7f8640004e50 2020-11-20T12:13:50.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.710+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00c040 con 0x7f8640004e50 2020-11-20T12:13:50.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.710+0000 7f8651ffb700 1 -- 172.21.15.160:0/2838883413 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c019e70 con 0x7f8640004e50 2020-11-20T12:13:50.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 -- 172.21.15.160:0/2838883413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8640004e50 msgr2=0x7f864000b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:50.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8640004e50 0x7f864000b730 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f863400d870 tx=0x7f864c008040).stop 2020-11-20T12:13:50.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 -- 172.21.15.160:0/2838883413 shutdown_connections 2020-11-20T12:13:50.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8640004e50 0x7f864000b730 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86400044e0 0x7f8640004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 --2- 172.21.15.160:0/2838883413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f8640003ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 -- 172.21.15.160:0/2838883413 >> 172.21.15.160:0/2838883413 conn(0x7f8654060b80 msgr2=0x7f86540c5120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:50.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 -- 172.21.15.160:0/2838883413 shutdown_connections 2020-11-20T12:13:50.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.711+0000 7f8653fff700 1 -- 172.21.15.160:0/2838883413 wait complete. 2020-11-20T12:13:50.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.713+0000 7f8653fff700 1 Processor -- start 2020-11-20T12:13:50.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.714+0000 7f8653fff700 1 -- start start 2020-11-20T12:13:50.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f8653fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f86541526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:50.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f8653fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86400044e0 0x7f86540c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:50.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f8653fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8640004e50 0x7f86540c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:50.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f8653fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86541148c0 con 0x7f8640004e50 2020-11-20T12:13:50.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f8653fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654152d40 con 0x7f86400044e0 2020-11-20T12:13:50.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f8653fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540bb3d0 con 0x7f86400038c0 2020-11-20T12:13:50.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f86527fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86400044e0 0x7f86540c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:50.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f86537fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8640004e50 0x7f86540c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:50.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f86527fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86400044e0 0x7f86540c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:50306/0 (socket says 172.21.15.160:50306) 2020-11-20T12:13:50.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f86527fc700 1 -- 172.21.15.160:0/3623201370 learned_addr learned my addr 172.21.15.160:0/3623201370 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:13:50.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.715+0000 7f8652ffd700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f86541526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:50.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f86527fc700 1 -- 172.21.15.160:0/3623201370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 msgr2=0x7f86541526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:50.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f86527fc700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f86541526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f86527fc700 1 -- 172.21.15.160:0/3623201370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8640004e50 msgr2=0x7f86540c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:50.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f86527fc700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8640004e50 0x7f86540c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f86527fc700 1 -- 172.21.15.160:0/3623201370 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654114380 con 0x7f86400044e0 2020-11-20T12:13:50.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f86537fe700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8640004e50 0x7f86540c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:50.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f86527fc700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86400044e0 0x7f86540c43d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8648014d80 tx=0x7f8648008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:50.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f863affd700 1 -- 172.21.15.160:0/3623201370 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8648014e80 con 0x7f86400044e0 2020-11-20T12:13:50.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.716+0000 7f863affd700 1 -- 172.21.15.160:0/3623201370 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8648012dc0 con 0x7f86400044e0 2020-11-20T12:13:50.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.717+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8654114620 con 0x7f86400044e0 2020-11-20T12:13:50.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.717+0000 7f863affd700 1 -- 172.21.15.160:0/3623201370 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8648016640 con 0x7f86400044e0 2020-11-20T12:13:50.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.717+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8654114000 con 0x7f86400044e0 2020-11-20T12:13:50.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.717+0000 7f863affd700 1 -- 172.21.15.160:0/3623201370 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f8648016cd0 con 0x7f86400044e0 2020-11-20T12:13:50.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.717+0000 7f863affd700 1 -- 172.21.15.160:0/3623201370 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f864801ec50 con 0x7f86400044e0 2020-11-20T12:13:50.759 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.718+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865407f250 con 0x7f86400044e0 2020-11-20T12:13:50.759 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.721+0000 7f863affd700 1 -- 172.21.15.160:0/3623201370 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f864801ee60 con 0x7f86400044e0 2020-11-20T12:13:50.819 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.815+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f8654044f60 con 0x7f86400044e0 2020-11-20T12:13:50.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.823+0000 7f863affd700 1 -- 172.21.15.160:0/3623201370 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f864801e400 con 0x7f86400044e0 2020-11-20T12:13:50.828 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86400044e0 msgr2=0x7f86540c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:50.828 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86400044e0 0x7f86540c43d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f8648014d80 tx=0x7f8648008040).stop 2020-11-20T12:13:50.829 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 shutdown_connections 2020-11-20T12:13:50.829 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8640004e50 0x7f86540c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.829 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f86400038c0 0x7f86541526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.829 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 --2- 172.21.15.160:0/3623201370 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f86400044e0 0x7f86540c43d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:50.829 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 >> 172.21.15.160:0/3623201370 conn(0x7f8654060b80 msgr2=0x7f8654151620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:50.830 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 shutdown_connections 2020-11-20T12:13:50.830 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:13:50.825+0000 7f8653fff700 1 -- 172.21.15.160:0/3623201370 wait complete. 2020-11-20T12:13:50.831 INFO:teuthology.orchestra.run.smithi160.stderr:adjusted tunables profile to default 2020-11-20T12:13:50.848 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T12:13:50.848 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:50.849 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T12:13:50.945 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T12:13:50.991 INFO:teuthology.orchestra.run.smithi160.stdout:533335c8-3a56-4df0-b5c8-b35679ee5b5e 2020-11-20T12:13:50.991 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:50.991 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:50.992 INFO:teuthology.orchestra.run.smithi160.stderr:37 bytes copied, 0.00014993 s, 247 kB/s 2020-11-20T12:13:50.994 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:50.995 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T12:13:51.043 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T12:13:51.083 INFO:teuthology.orchestra.run.smithi160.stdout:122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa 2020-11-20T12:13:51.084 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:51.084 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:51.084 INFO:teuthology.orchestra.run.smithi160.stderr:37 bytes copied, 0.000105958 s, 349 kB/s 2020-11-20T12:13:51.087 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:51.087 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T12:13:51.180 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T12:13:51.225 INFO:teuthology.orchestra.run.smithi160.stdout:68ef137b-dfa9-44ff-8de5-17008704111d 2020-11-20T12:13:51.225 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:51.226 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:51.226 INFO:teuthology.orchestra.run.smithi160.stderr:37 bytes copied, 0.000112831 s, 328 kB/s 2020-11-20T12:13:51.228 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:13:51.229 INFO:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T12:13:51.275 INFO:teuthology.orchestra.run.smithi160.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T12:13:51.311 INFO:teuthology.orchestra.run.smithi160.stdout:3e6b4d8b-aa11-45ae-a917-b52b3893997b 2020-11-20T12:13:51.311 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records in 2020-11-20T12:13:51.312 INFO:teuthology.orchestra.run.smithi160.stderr:0+1 records out 2020-11-20T12:13:51.312 INFO:teuthology.orchestra.run.smithi160.stderr:37 bytes copied, 0.000111817 s, 331 kB/s 2020-11-20T12:13:51.314 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:51.315 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T12:13:51.327 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T12:13:51.341 INFO:teuthology.orchestra.run.smithi150.stdout:69c7220e-b7d5-4197-bb17-6b52f7426847 2020-11-20T12:13:51.341 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:51.341 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:51.342 INFO:teuthology.orchestra.run.smithi150.stderr:37 bytes copied, 3.1056e-05 s, 1.2 MB/s 2020-11-20T12:13:51.342 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:51.343 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T12:13:51.396 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T12:13:51.410 INFO:teuthology.orchestra.run.smithi150.stdout:4766f07e-9808-49dc-b08e-8abda95ac061 2020-11-20T12:13:51.410 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:51.410 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:51.411 INFO:teuthology.orchestra.run.smithi150.stderr:37 bytes copied, 3.4169e-05 s, 1.1 MB/s 2020-11-20T12:13:51.412 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:51.412 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T12:13:51.478 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T12:13:51.492 INFO:teuthology.orchestra.run.smithi150.stdout:2ccbc6ef-df7b-476a-93b4-2557d2b0c120 2020-11-20T12:13:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:51.492 INFO:teuthology.orchestra.run.smithi150.stderr:37 bytes copied, 5.001e-05 s, 740 kB/s 2020-11-20T12:13:51.493 INFO:teuthology.orchestra.run.smithi150:> set -ex 2020-11-20T12:13:51.494 INFO:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T12:13:51.554 INFO:teuthology.orchestra.run.smithi150.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T12:13:51.568 INFO:teuthology.orchestra.run.smithi150.stdout:c447a333-a662-470d-9ba6-31bbca719e98 2020-11-20T12:13:51.568 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records in 2020-11-20T12:13:51.568 INFO:teuthology.orchestra.run.smithi150.stderr:0+1 records out 2020-11-20T12:13:51.569 INFO:teuthology.orchestra.run.smithi150.stderr:37 bytes copied, 3.5477e-05 s, 1.0 MB/s 2020-11-20T12:13:51.570 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:51.570 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T12:13:51.593 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T12:13:51.606 INFO:teuthology.orchestra.run.smithi134.stdout:5b83f099-523f-456e-875b-6f7c9997e306 2020-11-20T12:13:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:37 bytes copied, 3.6504e-05 s, 1.0 MB/s 2020-11-20T12:13:51.608 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:51.608 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T12:13:51.674 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T12:13:51.687 INFO:teuthology.orchestra.run.smithi134.stdout:4ad696e2-6079-4d68-a4d4-820e0f60dc30 2020-11-20T12:13:51.688 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:51.688 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:51.688 INFO:teuthology.orchestra.run.smithi134.stderr:37 bytes copied, 3.9884e-05 s, 928 kB/s 2020-11-20T12:13:51.689 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:51.690 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T12:13:51.751 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T12:13:51.765 INFO:teuthology.orchestra.run.smithi134.stdout:c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5 2020-11-20T12:13:51.765 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:51.765 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:51.765 INFO:teuthology.orchestra.run.smithi134.stderr:37 bytes copied, 3.4746e-05 s, 1.1 MB/s 2020-11-20T12:13:51.766 INFO:teuthology.orchestra.run.smithi134:> set -ex 2020-11-20T12:13:51.767 INFO:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T12:13:51.837 INFO:teuthology.orchestra.run.smithi134.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T12:13:51.853 INFO:teuthology.orchestra.run.smithi134.stdout:ef60d791-08b7-4edc-991b-be018728ea35 2020-11-20T12:13:51.854 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records in 2020-11-20T12:13:51.854 INFO:teuthology.orchestra.run.smithi134.stderr:0+1 records out 2020-11-20T12:13:51.854 INFO:teuthology.orchestra.run.smithi134.stderr:37 bytes copied, 3.0626e-05 s, 1.2 MB/s 2020-11-20T12:13:51.855 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 533335c8-3a56-4df0-b5c8-b35679ee5b5e 0 2020-11-20T12:13:52.020 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.017+0000 7ffaadd75700 1 Processor -- start 2020-11-20T12:13:52.020 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.017+0000 7ffaadd75700 1 -- start start 2020-11-20T12:13:52.023 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.017+0000 7ffaadd75700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ffaa80c3170 0x7ffaa80c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.023 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.017+0000 7ffaadd75700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa814e420 con 0x7ffaa8151dc0 2020-11-20T12:13:52.024 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.017+0000 7ffaadd75700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa80bc960 con 0x7ffaa80baef0 2020-11-20T12:13:52.024 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.017+0000 7ffaadd75700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa80bcc00 con 0x7ffaa80c3170 2020-11-20T12:13:52.024 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa7fff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ffaa8151dc0 0x7ffaa814cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49528/0 (socket says 172.21.15.134:49528) 2020-11-20T12:13:52.024 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa7fff700 1 -- 172.21.15.134:0/1360836267 learned_addr learned my addr 172.21.15.134:0/1360836267 (peer_addr_for_me v1:172.21.15.134:0/0) 2020-11-20T12:13:52.025 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053115456 0 0) 0x7ffaa0001450 con 0x7ffaa8151dc0 2020-11-20T12:13:52.025 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa88003240 con 0x7ffaa8151dc0 2020-11-20T12:13:52.025 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa77fe700 1 --2- 172.21.15.134:0/1360836267 >> v2:172.21.15.160:3300/0 conn(0x7ffaa80c3170 0x7ffaa80c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.025 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3323947892 0 0) 0x7ffa88003240 con 0x7ffaa8151dc0 2020-11-20T12:13:52.025 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 >> v2:172.21.15.160:3300/0 conn(0x7ffaa80c3170 msgr2=0x7ffaa80c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.026 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 --2- 172.21.15.134:0/1360836267 >> v2:172.21.15.160:3300/0 conn(0x7ffaa80c3170 0x7ffaa80c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.026 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 >> v1:172.21.15.160:6789/0 conn(0x7ffaa80baef0 legacy=0x7ffaa80c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.026 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa81513e0 con 0x7ffaa8151dc0 2020-11-20T12:13:52.026 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7ffaa00019f0 con 0x7ffaa8151dc0 2020-11-20T12:13:52.026 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 >> v1:172.21.15.134:6789/0 conn(0x7ffaa8151dc0 legacy=0x7ffaa814cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.027 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa88003780 0x7ffa88003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.027 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa880044e0 0x7ffa88004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.027 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffa8800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.027 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80bcc00 con 0x7ffa88004e50 2020-11-20T12:13:52.028 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88004290 con 0x7ffa880044e0 2020-11-20T12:13:52.028 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8800bc20 con 0x7ffa88003780 2020-11-20T12:13:52.028 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa7fff700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffa8800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.028 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa7fff700 1 -- 172.21.15.134:0/1360836267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa88003780 msgr2=0x7ffa88003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.028 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa7fff700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa88003780 0x7ffa88003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.029 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffaa7fff700 1 -- 172.21.15.134:0/1360836267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa880044e0 msgr2=0x7ffa88004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.029 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.018+0000 7ffa9effd700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa880044e0 0x7ffa88004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.029 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaa7fff700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa880044e0 0x7ffa88004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.029 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaa7fff700 1 -- 172.21.15.134:0/1360836267 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88003240 con 0x7ffa88004e50 2020-11-20T12:13:52.030 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffa9effd700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffa880044e0 0x7ffa88004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:13:52.030 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaa7fff700 1 -- 172.21.15.134:0/1360836267 reap_dead start 2020-11-20T12:13:52.030 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaa7fff700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffa8800b730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ffaa000c870 tx=0x7ffaa80bcaf0).ready entity=mon.0 client_cookie=746569c80a73ab73 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.030 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0005b80 con 0x7ffa88004e50 2020-11-20T12:13:52.030 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0005ce0 con 0x7ffa88004e50 2020-11-20T12:13:52.031 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaa6ffd700 1 -- 172.21.15.134:0/1360836267 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0007340 con 0x7ffa88004e50 2020-11-20T12:13:52.031 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaadd75700 1 -- 172.21.15.134:0/1360836267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 msgr2=0x7ffa8800b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.031 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaadd75700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffa8800b730 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ffaa000c870 tx=0x7ffaa80bcaf0).stop 2020-11-20T12:13:52.031 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaadd75700 1 -- 172.21.15.134:0/1360836267 shutdown_connections 2020-11-20T12:13:52.031 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaadd75700 1 --2- 172.21.15.134:0/1360836267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffa8800b730 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.032 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaadd75700 1 -- 172.21.15.134:0/1360836267 >> 172.21.15.134:0/1360836267 conn(0x7ffaa8060140 msgr2=0x7ffaa8060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.032 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaadd75700 1 -- 172.21.15.134:0/1360836267 shutdown_connections 2020-11-20T12:13:52.032 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.019+0000 7ffaadd75700 1 -- 172.21.15.134:0/1360836267 wait complete. 2020-11-20T12:13:52.032 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.020+0000 7ffaadd75700 1 Processor -- start 2020-11-20T12:13:52.035 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaadd75700 1 -- start start 2020-11-20T12:13:52.035 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaadd75700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffaa815e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.035 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaadd75700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa8148500 0x7ffaa8161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.035 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaadd75700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa8065220 0x7ffaa810db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.036 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaadd75700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa80c2d50 con 0x7ffa88004e50 2020-11-20T12:13:52.036 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaadd75700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa81493a0 con 0x7ffaa8065220 2020-11-20T12:13:52.036 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaadd75700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa8148960 con 0x7ffaa8148500 2020-11-20T12:13:52.036 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaa77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffaa815e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.036 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaa77fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffaa815e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36768/0 (socket says 172.21.15.134:36768) 2020-11-20T12:13:52.037 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaa77fe700 1 -- 172.21.15.134:0/3585358643 learned_addr learned my addr 172.21.15.134:0/3585358643 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:52.037 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.021+0000 7ffaa7fff700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa8065220 0x7ffaa810db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.037 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaa77fe700 1 -- 172.21.15.134:0/3585358643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa8148500 msgr2=0x7ffaa8161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.037 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaa77fe700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa8148500 0x7ffaa8161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.038 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaa77fe700 1 -- 172.21.15.134:0/3585358643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa8065220 msgr2=0x7ffaa810db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.038 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaa77fe700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa8065220 0x7ffaa810db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.038 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaa77fe700 1 -- 172.21.15.134:0/3585358643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa8148bc0 con 0x7ffa88004e50 2020-11-20T12:13:52.038 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaa77fe700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffaa815e070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ffa9000a7e0 tx=0x7ffa90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.038 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffa9ffff700 1 -- 172.21.15.134:0/3585358643 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000e5d0 con 0x7ffa88004e50 2020-11-20T12:13:52.039 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffa9ffff700 1 -- 172.21.15.134:0/3585358643 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000c030 con 0x7ffa88004e50 2020-11-20T12:13:52.039 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffa9ffff700 1 -- 172.21.15.134:0/3585358643 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000e940 con 0x7ffa88004e50 2020-11-20T12:13:52.039 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa8148e60 con 0x7ffa88004e50 2020-11-20T12:13:52.039 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa8161720 con 0x7ffa88004e50 2020-11-20T12:13:52.039 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffa9ffff700 1 -- 172.21.15.134:0/3585358643 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ffa9000ecf0 con 0x7ffa88004e50 2020-11-20T12:13:52.040 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.022+0000 7ffa9ffff700 1 -- 172.21.15.134:0/3585358643 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7ffa9001b3f0 con 0x7ffa88004e50 2020-11-20T12:13:52.040 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.023+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa81515c0 con 0x7ffa88004e50 2020-11-20T12:13:52.040 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.025+0000 7ffa9ffff700 1 -- 172.21.15.134:0/3585358643 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7ffa90020060 con 0x7ffa88004e50 2020-11-20T12:13:52.119 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.116+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "533335c8-3a56-4df0-b5c8-b35679ee5b5e", "id": 0} v 0) v1 -- 0x7ffaa8069460 con 0x7ffa88004e50 2020-11-20T12:13:52.125 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.122+0000 7ffa9ffff700 1 -- 172.21.15.134:0/3585358643 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "533335c8-3a56-4df0-b5c8-b35679ee5b5e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa90012e60 con 0x7ffa88004e50 2020-11-20T12:13:52.125 INFO:teuthology.orchestra.run.smithi134.stdout:0 2020-11-20T12:13:52.127 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 msgr2=0x7ffaa815e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.127 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffaa815e070 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7ffa9000a7e0 tx=0x7ffa90008040).stop 2020-11-20T12:13:52.127 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 shutdown_connections 2020-11-20T12:13:52.127 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffaa8065220 0x7ffaa810db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.128 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa88004e50 0x7ffaa815e070 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.128 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 --2- 172.21.15.134:0/3585358643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaa8148500 0x7ffaa8161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.128 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 >> 172.21.15.134:0/3585358643 conn(0x7ffaa8060140 msgr2=0x7ffaa8060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.128 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 shutdown_connections 2020-11-20T12:13:52.128 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.123+0000 7ffaadd75700 1 -- 172.21.15.134:0/3585358643 wait complete. 2020-11-20T12:13:52.137 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 69c7220e-b7d5-4197-bb17-6b52f7426847 1 2020-11-20T12:13:52.259 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.256+0000 7f1f1ed19700 1 Processor -- start 2020-11-20T12:13:52.259 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.256+0000 7f1f1ed19700 1 -- start start 2020-11-20T12:13:52.261 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.256+0000 7f1f1ed19700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f18061870 0x7f1f18061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.262 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.256+0000 7f1f1ed19700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1814f500 con 0x7f1f180c00d0 2020-11-20T12:13:52.262 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.256+0000 7f1f1ed19700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1814f7a0 con 0x7f1f18066a20 2020-11-20T12:13:52.262 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.256+0000 7f1f1ed19700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f1814fa40 con 0x7f1f18061870 2020-11-20T12:13:52.262 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1cab5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f18061870 0x7f1f18061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.263 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1cab5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1f18061870 0x7f1f18061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.134:55518/0 (socket says 172.21.15.134:55518) 2020-11-20T12:13:52.263 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1cab5700 1 -- 172.21.15.134:0/2842340694 learned_addr learned my addr 172.21.15.134:0/2842340694 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:52.263 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1d2b6700 1 --1- 172.21.15.134:0/2842340694 >> v1:172.21.15.150:6789/0 conn(0x7f1f180c00d0 0x7f1f1814df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.134:59380/0 (socket says 172.21.15.134:59380) 2020-11-20T12:13:52.263 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1cab5700 1 -- 172.21.15.134:0/2842340694 >> v1:172.21.15.160:6789/0 conn(0x7f1f18066a20 legacy=0x7f1f180c1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.263 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1cab5700 1 -- 172.21.15.134:0/2842340694 >> v1:172.21.15.150:6789/0 conn(0x7f1f180c00d0 legacy=0x7f1f1814df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.264 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1cab5700 1 -- 172.21.15.134:0/2842340694 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f180c0b40 con 0x7f1f18061870 2020-11-20T12:13:52.264 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f1cab5700 1 --2- 172.21.15.134:0/2842340694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18061870 0x7f1f18061c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1f10009d50 tx=0x7f1f10009290).ready entity=mon.1 client_cookie=f6085a46649ffa62 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.264 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f177fe700 1 -- 172.21.15.134:0/2842340694 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1000bcd0 con 0x7f1f18061870 2020-11-20T12:13:52.264 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f177fe700 1 -- 172.21.15.134:0/2842340694 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1000be30 con 0x7f1f18061870 2020-11-20T12:13:52.264 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.257+0000 7f1f177fe700 1 -- 172.21.15.134:0/2842340694 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10011610 con 0x7f1f18061870 2020-11-20T12:13:52.265 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.258+0000 7f1f1ed19700 1 -- 172.21.15.134:0/2842340694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18061870 msgr2=0x7f1f18061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.265 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.258+0000 7f1f1ed19700 1 --2- 172.21.15.134:0/2842340694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18061870 0x7f1f18061c50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1f10009d50 tx=0x7f1f10009290).stop 2020-11-20T12:13:52.265 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.258+0000 7f1f1ed19700 1 -- 172.21.15.134:0/2842340694 shutdown_connections 2020-11-20T12:13:52.265 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.258+0000 7f1f1ed19700 1 --2- 172.21.15.134:0/2842340694 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f18061870 0x7f1f18061c50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.265 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.258+0000 7f1f1ed19700 1 -- 172.21.15.134:0/2842340694 >> 172.21.15.134:0/2842340694 conn(0x7f1f180651c0 msgr2=0x7f1f180627c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.266 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.258+0000 7f1f1ed19700 1 -- 172.21.15.134:0/2842340694 shutdown_connections 2020-11-20T12:13:52.266 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.258+0000 7f1f1ed19700 1 -- 172.21.15.134:0/2842340694 wait complete. 2020-11-20T12:13:52.268 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.259+0000 7f1f1ed19700 1 Processor -- start 2020-11-20T12:13:52.269 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.259+0000 7f1f1ed19700 1 -- start start 2020-11-20T12:13:52.269 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1ed19700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f18061870 0x7f1f1810e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.269 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1ed19700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f18066a20 0x7f1f181505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.269 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1ed19700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f180c00d0 0x7f1f181523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.269 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1ed19700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f181100a0 con 0x7f1f18061870 2020-11-20T12:13:52.270 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1ed19700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f181623f0 con 0x7f1f180c00d0 2020-11-20T12:13:52.270 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1ed19700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f18161ed0 con 0x7f1f18066a20 2020-11-20T12:13:52.270 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f18061870 0x7f1f1810e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.270 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f18061870 0x7f1f1810e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36780/0 (socket says 172.21.15.134:36780) 2020-11-20T12:13:52.271 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 -- 172.21.15.134:0/1282471152 learned_addr learned my addr 172.21.15.134:0/1282471152 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:52.271 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1d2b6700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f180c00d0 0x7f1f181523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.271 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f17fff700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f18066a20 0x7f1f181505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.271 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 -- 172.21.15.134:0/1282471152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f18066a20 msgr2=0x7f1f181505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.271 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f18066a20 0x7f1f181505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.272 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 -- 172.21.15.134:0/1282471152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f180c00d0 msgr2=0x7f1f181523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.272 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f180c00d0 0x7f1f181523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.272 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 -- 172.21.15.134:0/1282471152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f18162150 con 0x7f1f18061870 2020-11-20T12:13:52.272 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f1cab5700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f18061870 0x7f1f1810e940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1f18063ad0 tx=0x7f1f10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.272 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.260+0000 7f1f14ff9700 1 -- 172.21.15.134:0/1282471152 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1001b6b0 con 0x7f1f18061870 2020-11-20T12:13:52.273 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.261+0000 7f1f14ff9700 1 -- 172.21.15.134:0/1282471152 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1001b810 con 0x7f1f18061870 2020-11-20T12:13:52.273 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.261+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f18110290 con 0x7f1f18061870 2020-11-20T12:13:52.273 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.261+0000 7f1f14ff9700 1 -- 172.21.15.134:0/1282471152 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1001bbb0 con 0x7f1f18061870 2020-11-20T12:13:52.273 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.261+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f181107d0 con 0x7f1f18061870 2020-11-20T12:13:52.273 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.261+0000 7f1f14ff9700 1 -- 172.21.15.134:0/1282471152 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f1f10017070 con 0x7f1f18061870 2020-11-20T12:13:52.274 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.261+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f18110990 con 0x7f1f18061870 2020-11-20T12:13:52.274 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.261+0000 7f1f14ff9700 1 -- 172.21.15.134:0/1282471152 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f1f10026840 con 0x7f1f18061870 2020-11-20T12:13:52.274 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.264+0000 7f1f14ff9700 1 -- 172.21.15.134:0/1282471152 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f1f10015020 con 0x7f1f18061870 2020-11-20T12:13:52.358 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.355+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "69c7220e-b7d5-4197-bb17-6b52f7426847", "id": 1} v 0) v1 -- 0x7f1f18069460 con 0x7f1f18061870 2020-11-20T12:13:52.363 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.360+0000 7f1f14ff9700 1 -- 172.21.15.134:0/1282471152 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "69c7220e-b7d5-4197-bb17-6b52f7426847", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1f10026b60 con 0x7f1f18061870 2020-11-20T12:13:52.363 INFO:teuthology.orchestra.run.smithi134.stdout:1 2020-11-20T12:13:52.365 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f18061870 msgr2=0x7f1f1810e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.365 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f18061870 0x7f1f1810e940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f1f18063ad0 tx=0x7f1f10016000).stop 2020-11-20T12:13:52.365 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 shutdown_connections 2020-11-20T12:13:52.365 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f180c00d0 0x7f1f181523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.366 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f18061870 0x7f1f1810e940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.366 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 --2- 172.21.15.134:0/1282471152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f18066a20 0x7f1f181505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.366 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 >> 172.21.15.134:0/1282471152 conn(0x7f1f180651c0 msgr2=0x7f1f1814b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.366 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 shutdown_connections 2020-11-20T12:13:52.366 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.361+0000 7f1f1ed19700 1 -- 172.21.15.134:0/1282471152 wait complete. 2020-11-20T12:13:52.375 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 5b83f099-523f-456e-875b-6f7c9997e306 2 2020-11-20T12:13:52.514 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.511+0000 7f2b9c83b700 1 Processor -- start 2020-11-20T12:13:52.515 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.511+0000 7f2b9c83b700 1 -- start start 2020-11-20T12:13:52.516 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9c83b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b980c3170 0x7f2b980c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.517 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9c83b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2b98151dc0 0x7f2b9814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.517 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9c83b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b980bc960 con 0x7f2b980baef0 2020-11-20T12:13:52.517 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9c83b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b980bcc00 con 0x7f2b980c3170 2020-11-20T12:13:52.517 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9c83b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b981513e0 con 0x7f2b98151dc0 2020-11-20T12:13:52.518 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9659c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b980c3170 0x7f2b980c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.518 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9659c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2b980c3170 0x7f2b980c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36786/0 (socket says 172.21.15.134:36786) 2020-11-20T12:13:52.518 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9659c700 1 -- 172.21.15.134:0/1795747281 learned_addr learned my addr 172.21.15.134:0/1795747281 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:52.518 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9659c700 1 -- 172.21.15.134:0/1795747281 >> v2:172.21.15.160:3300/0 conn(0x7f2b98151dc0 msgr2=0x7f2b9814cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.519 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9659c700 1 --2- 172.21.15.134:0/1795747281 >> v2:172.21.15.160:3300/0 conn(0x7f2b98151dc0 0x7f2b9814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.519 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9659c700 1 -- 172.21.15.134:0/1795747281 >> v1:172.21.15.150:6789/0 conn(0x7f2b980baef0 legacy=0x7f2b980c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.519 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.512+0000 7f2b9659c700 1 -- 172.21.15.134:0/1795747281 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98151680 con 0x7f2b980c3170 2020-11-20T12:13:52.519 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9659c700 1 --2- 172.21.15.134:0/1795747281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b980c3170 0x7f2b980c3550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f2b980bdee0 tx=0x7f2b90009290).ready entity=mon.0 client_cookie=fdbdec6188e0927 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.519 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9559a700 1 -- 172.21.15.134:0/1795747281 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9000bc50 con 0x7f2b980c3170 2020-11-20T12:13:52.520 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9559a700 1 -- 172.21.15.134:0/1795747281 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9000bdb0 con 0x7f2b980c3170 2020-11-20T12:13:52.520 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9559a700 1 -- 172.21.15.134:0/1795747281 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90011610 con 0x7f2b980c3170 2020-11-20T12:13:52.520 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 -- 172.21.15.134:0/1795747281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b980c3170 msgr2=0x7f2b980c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.520 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 --2- 172.21.15.134:0/1795747281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b980c3170 0x7f2b980c3550 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f2b980bdee0 tx=0x7f2b90009290).stop 2020-11-20T12:13:52.520 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 -- 172.21.15.134:0/1795747281 shutdown_connections 2020-11-20T12:13:52.521 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 --2- 172.21.15.134:0/1795747281 >> v2:172.21.15.160:3300/0 conn(0x7f2b98151dc0 0x7f2b9814cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.521 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 --2- 172.21.15.134:0/1795747281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b980c3170 0x7f2b980c3550 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.521 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 -- 172.21.15.134:0/1795747281 >> 172.21.15.134:0/1795747281 conn(0x7f2b98060140 msgr2=0x7f2b98060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.521 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 -- 172.21.15.134:0/1795747281 shutdown_connections 2020-11-20T12:13:52.521 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.513+0000 7f2b9c83b700 1 -- 172.21.15.134:0/1795747281 wait complete. 2020-11-20T12:13:52.524 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 Processor -- start 2020-11-20T12:13:52.524 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 -- start start 2020-11-20T12:13:52.524 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b980baef0 0x7f2b9814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.524 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b980c3170 0x7f2b980c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.525 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b98151dc0 0x7f2b98146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.525 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b981639c0 con 0x7f2b98151dc0 2020-11-20T12:13:52.525 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98163c20 con 0x7f2b980baef0 2020-11-20T12:13:52.525 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.515+0000 7f2b9c83b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b98163ec0 con 0x7f2b980c3170 2020-11-20T12:13:52.525 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b98151dc0 0x7f2b98146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.526 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b98151dc0 0x7f2b98146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36796/0 (socket says 172.21.15.134:36796) 2020-11-20T12:13:52.526 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b9659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b980baef0 0x7f2b9814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.526 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 -- 172.21.15.134:0/2855399982 learned_addr learned my addr 172.21.15.134:0/2855399982 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:52.526 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b95d9b700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b980c3170 0x7f2b980c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.526 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 -- 172.21.15.134:0/2855399982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b980c3170 msgr2=0x7f2b980c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.527 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b980c3170 0x7f2b980c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.527 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 -- 172.21.15.134:0/2855399982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b980baef0 msgr2=0x7f2b9814d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.527 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b980baef0 0x7f2b9814d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.527 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 -- 172.21.15.134:0/2855399982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98164160 con 0x7f2b98151dc0 2020-11-20T12:13:52.528 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b9659c700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b980baef0 0x7f2b9814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:52.528 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b96d9d700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b98151dc0 0x7f2b98146290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2b88009760 tx=0x7f2b88006e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.528 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b867fc700 1 -- 172.21.15.134:0/2855399982 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800d560 con 0x7f2b98151dc0 2020-11-20T12:13:52.528 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b867fc700 1 -- 172.21.15.134:0/2855399982 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88000e90 con 0x7f2b98151dc0 2020-11-20T12:13:52.528 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b98164400 con 0x7f2b98151dc0 2020-11-20T12:13:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b867fc700 1 -- 172.21.15.134:0/2855399982 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8800d910 con 0x7f2b98151dc0 2020-11-20T12:13:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9814ed00 con 0x7f2b98151dc0 2020-11-20T12:13:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b867fc700 1 -- 172.21.15.134:0/2855399982 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f2b8800f070 con 0x7f2b98151dc0 2020-11-20T12:13:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.516+0000 7f2b867fc700 1 -- 172.21.15.134:0/2855399982 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f2b8801c3f0 con 0x7f2b98151dc0 2020-11-20T12:13:52.529 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.517+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98151860 con 0x7f2b98151dc0 2020-11-20T12:13:52.530 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.519+0000 7f2b867fc700 1 -- 172.21.15.134:0/2855399982 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f2b880134b0 con 0x7f2b98151dc0 2020-11-20T12:13:52.612 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.609+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5b83f099-523f-456e-875b-6f7c9997e306", "id": 2} v 0) v1 -- 0x7f2b98069460 con 0x7f2b98151dc0 2020-11-20T12:13:52.616 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.613+0000 7f2b867fc700 1 -- 172.21.15.134:0/2855399982 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b83f099-523f-456e-875b-6f7c9997e306", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b88013a50 con 0x7f2b98151dc0 2020-11-20T12:13:52.616 INFO:teuthology.orchestra.run.smithi134.stdout:2 2020-11-20T12:13:52.618 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b98151dc0 msgr2=0x7f2b98146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.618 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b98151dc0 0x7f2b98146290 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2b88009760 tx=0x7f2b88006e40).stop 2020-11-20T12:13:52.618 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 shutdown_connections 2020-11-20T12:13:52.618 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b98151dc0 0x7f2b98146290 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.619 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2b980baef0 0x7f2b9814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.619 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 --2- 172.21.15.134:0/2855399982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2b980c3170 0x7f2b980c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.619 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 >> 172.21.15.134:0/2855399982 conn(0x7f2b98060140 msgr2=0x7f2b98063120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.619 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 shutdown_connections 2020-11-20T12:13:52.619 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.614+0000 7f2b9c83b700 1 -- 172.21.15.134:0/2855399982 wait complete. 2020-11-20T12:13:52.628 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa 3 2020-11-20T12:13:52.750 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.746+0000 7f5904070700 1 Processor -- start 2020-11-20T12:13:52.750 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.747+0000 7f5904070700 1 -- start start 2020-11-20T12:13:52.752 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.747+0000 7f5904070700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f58fc0630e0 0x7f58fc0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.752 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.747+0000 7f5904070700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58fc0ba4e0 0x7f58fc151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.753 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.747+0000 7f5904070700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58fc0bbd30 con 0x7f58fc0c3d00 2020-11-20T12:13:52.753 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.747+0000 7f5904070700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc151950 con 0x7f58fc0ba4e0 2020-11-20T12:13:52.753 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.747+0000 7f5904070700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58fc14d4b0 con 0x7f58fc0630e0 2020-11-20T12:13:52.753 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58fc0ba4e0 0x7f58fc151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.754 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58fc0ba4e0 0x7f58fc151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36802/0 (socket says 172.21.15.134:36802) 2020-11-20T12:13:52.754 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 -- 172.21.15.134:0/2991667126 learned_addr learned my addr 172.21.15.134:0/2991667126 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:52.754 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 -- 172.21.15.134:0/2991667126 >> v2:172.21.15.160:3300/0 conn(0x7f58fc0630e0 msgr2=0x7f58fc0634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.754 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 --2- 172.21.15.134:0/2991667126 >> v2:172.21.15.160:3300/0 conn(0x7f58fc0630e0 0x7f58fc0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.754 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 -- 172.21.15.134:0/2991667126 >> v1:172.21.15.150:6789/0 conn(0x7f58fc0c3d00 legacy=0x7f58fc14de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.755 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 -- 172.21.15.134:0/2991667126 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0bbf90 con 0x7f58fc0ba4e0 2020-11-20T12:13:52.755 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f590260d700 1 --2- 172.21.15.134:0/2991667126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0ba4e0 0x7f58fc151460 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f58fc0644d0 tx=0x7f58f8006eb0).ready entity=mon.0 client_cookie=b6c4077b2480e337 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.755 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f5900e0a700 1 -- 172.21.15.134:0/2991667126 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f80098d0 con 0x7f58fc0ba4e0 2020-11-20T12:13:52.755 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f5900e0a700 1 -- 172.21.15.134:0/2991667126 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f8009a30 con 0x7f58fc0ba4e0 2020-11-20T12:13:52.755 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.748+0000 7f5900e0a700 1 -- 172.21.15.134:0/2991667126 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8009db0 con 0x7f58fc0ba4e0 2020-11-20T12:13:52.756 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 -- 172.21.15.134:0/2991667126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0ba4e0 msgr2=0x7f58fc151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.756 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 --2- 172.21.15.134:0/2991667126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0ba4e0 0x7f58fc151460 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f58fc0644d0 tx=0x7f58f8006eb0).stop 2020-11-20T12:13:52.756 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 -- 172.21.15.134:0/2991667126 shutdown_connections 2020-11-20T12:13:52.756 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 --2- 172.21.15.134:0/2991667126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0ba4e0 0x7f58fc151460 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.756 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 --2- 172.21.15.134:0/2991667126 >> v2:172.21.15.160:3300/0 conn(0x7f58fc0630e0 0x7f58fc0634c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.757 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 -- 172.21.15.134:0/2991667126 >> 172.21.15.134:0/2991667126 conn(0x7f58fc060140 msgr2=0x7f58fc060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.757 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 -- 172.21.15.134:0/2991667126 shutdown_connections 2020-11-20T12:13:52.757 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.749+0000 7f5904070700 1 -- 172.21.15.134:0/2991667126 wait complete. 2020-11-20T12:13:52.759 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.750+0000 7f5904070700 1 Processor -- start 2020-11-20T12:13:52.759 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.750+0000 7f5904070700 1 -- start start 2020-11-20T12:13:52.760 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5904070700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0630e0 0x7f58fc15d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.760 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5904070700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0ba4e0 0x7f58fc1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.760 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5904070700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58fc0c3d00 0x7f58fc10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.760 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5904070700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1501f0 con 0x7f58fc0630e0 2020-11-20T12:13:52.760 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5904070700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc15d5c0 con 0x7f58fc0ba4e0 2020-11-20T12:13:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5904070700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc15d840 con 0x7f58fc0c3d00 2020-11-20T12:13:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0630e0 0x7f58fc15d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0630e0 0x7f58fc15d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36804/0 (socket says 172.21.15.134:36804) 2020-11-20T12:13:52.761 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 -- 172.21.15.134:0/660220736 learned_addr learned my addr 172.21.15.134:0/660220736 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:52.762 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f590160b700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0ba4e0 0x7f58fc1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.762 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f590260d700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58fc0c3d00 0x7f58fc10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.762 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 -- 172.21.15.134:0/660220736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58fc0c3d00 msgr2=0x7f58fc10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.762 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58fc0c3d00 0x7f58fc10d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.762 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 -- 172.21.15.134:0/660220736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0ba4e0 msgr2=0x7f58fc1508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.763 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0ba4e0 0x7f58fc1508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.763 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 -- 172.21.15.134:0/660220736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc15dae0 con 0x7f58fc0630e0 2020-11-20T12:13:52.763 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5901e0c700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0630e0 0x7f58fc15d0d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f58f400bae0 tx=0x7f58f4009220).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.763 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f58edffb700 1 -- 172.21.15.134:0/660220736 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400c830 con 0x7f58fc0630e0 2020-11-20T12:13:52.763 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f58edffb700 1 -- 172.21.15.134:0/660220736 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f400c990 con 0x7f58fc0630e0 2020-11-20T12:13:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f58edffb700 1 -- 172.21.15.134:0/660220736 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f400cb40 con 0x7f58fc0630e0 2020-11-20T12:13:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc15dd80 con 0x7f58fc0630e0 2020-11-20T12:13:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.751+0000 7f58edffb700 1 -- 172.21.15.134:0/660220736 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f58f4015680 con 0x7f58fc0630e0 2020-11-20T12:13:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.752+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc0c13c0 con 0x7f58fc0630e0 2020-11-20T12:13:52.764 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.752+0000 7f58edffb700 1 -- 172.21.15.134:0/660220736 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f58f4015af0 con 0x7f58fc0630e0 2020-11-20T12:13:52.765 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.752+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc069460 con 0x7f58fc0630e0 2020-11-20T12:13:52.765 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.754+0000 7f58edffb700 1 -- 172.21.15.134:0/660220736 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f58f401a060 con 0x7f58fc0630e0 2020-11-20T12:13:52.849 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.846+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa", "id": 3} v 0) v1 -- 0x7f58fc0bc860 con 0x7f58fc0630e0 2020-11-20T12:13:52.853 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.850+0000 7f58edffb700 1 -- 172.21.15.134:0/660220736 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58f401f430 con 0x7f58fc0630e0 2020-11-20T12:13:52.853 INFO:teuthology.orchestra.run.smithi134.stdout:3 2020-11-20T12:13:52.854 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0630e0 msgr2=0x7f58fc15d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.854 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0630e0 0x7f58fc15d0d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f58f400bae0 tx=0x7f58f4009220).stop 2020-11-20T12:13:52.855 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 shutdown_connections 2020-11-20T12:13:52.855 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58fc0c3d00 0x7f58fc10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.855 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58fc0630e0 0x7f58fc15d0d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.855 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 --2- 172.21.15.134:0/660220736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58fc0ba4e0 0x7f58fc1508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.855 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 >> 172.21.15.134:0/660220736 conn(0x7f58fc060140 msgr2=0x7f58fc1471b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.856 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 shutdown_connections 2020-11-20T12:13:52.856 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.851+0000 7f5904070700 1 -- 172.21.15.134:0/660220736 wait complete. 2020-11-20T12:13:52.865 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 4766f07e-9808-49dc-b08e-8abda95ac061 4 2020-11-20T12:13:52.986 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.982+0000 7fb084fe3700 1 Processor -- start 2020-11-20T12:13:52.986 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.982+0000 7fb084fe3700 1 -- start start 2020-11-20T12:13:52.990 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.983+0000 7fb084fe3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0800c3d00 0x7fb0800634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.991 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.983+0000 7fb084fe3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb0800ba4e0 0x7fb080151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:52.991 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.983+0000 7fb084fe3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800bbd30 con 0x7fb0800630e0 2020-11-20T12:13:52.991 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.983+0000 7fb084fe3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb080151950 con 0x7fb0800c3d00 2020-11-20T12:13:52.992 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.983+0000 7fb084fe3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08014d4b0 con 0x7fb0800ba4e0 2020-11-20T12:13:52.992 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07dd9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb0800c3d00 0x7fb0800634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:52.992 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07e59c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb0800630e0 0x7fb08014de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49578/0 (socket says 172.21.15.134:49578) 2020-11-20T12:13:52.992 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07e59c700 1 -- 172.21.15.134:0/759855963 learned_addr learned my addr 172.21.15.134:0/759855963 (peer_addr_for_me v1:172.21.15.134:0/0) 2020-11-20T12:13:52.993 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07dd9b700 1 -- 172.21.15.134:0/759855963 >> v2:172.21.15.160:3300/0 conn(0x7fb0800ba4e0 msgr2=0x7fb080151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:52.993 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07dd9b700 1 --2- 172.21.15.134:0/759855963 >> v2:172.21.15.160:3300/0 conn(0x7fb0800ba4e0 0x7fb080151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.993 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07dd9b700 1 -- 172.21.15.134:0/759855963 >> v1:172.21.15.134:6789/0 conn(0x7fb0800630e0 legacy=0x7fb08014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.993 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07dd9b700 1 -- 172.21.15.134:0/759855963 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800bbf90 con 0x7fb0800c3d00 2020-11-20T12:13:52.994 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07d59a700 1 -- 172.21.15.134:0/759855963 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548540055 0 0) 0x7fb0800bbd30 con 0x7fb0800630e0 2020-11-20T12:13:52.994 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07dd9b700 1 --2- 172.21.15.134:0/759855963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800c3d00 0x7fb0800634c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb0800bdaf0 tx=0x7fb068006df0).ready entity=mon.0 client_cookie=b0f5dea97805dc34 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:52.994 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07d59a700 1 -- 172.21.15.134:0/759855963 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680097b0 con 0x7fb0800c3d00 2020-11-20T12:13:52.995 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07d59a700 1 -- 172.21.15.134:0/759855963 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb068009910 con 0x7fb0800c3d00 2020-11-20T12:13:52.995 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.984+0000 7fb07d59a700 1 -- 172.21.15.134:0/759855963 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068009c90 con 0x7fb0800c3d00 2020-11-20T12:13:52.995 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 -- 172.21.15.134:0/759855963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800c3d00 msgr2=0x7fb0800634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:52.995 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 --2- 172.21.15.134:0/759855963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800c3d00 0x7fb0800634c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fb0800bdaf0 tx=0x7fb068006df0).stop 2020-11-20T12:13:52.996 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 -- 172.21.15.134:0/759855963 shutdown_connections 2020-11-20T12:13:52.996 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 --2- 172.21.15.134:0/759855963 >> v2:172.21.15.160:3300/0 conn(0x7fb0800ba4e0 0x7fb080151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:52.996 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 --2- 172.21.15.134:0/759855963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800c3d00 0x7fb0800634c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:52.997 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 -- 172.21.15.134:0/759855963 >> 172.21.15.134:0/759855963 conn(0x7fb080060140 msgr2=0x7fb080060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:52.997 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 -- 172.21.15.134:0/759855963 shutdown_connections 2020-11-20T12:13:52.997 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.985+0000 7fb084fe3700 1 -- 172.21.15.134:0/759855963 wait complete. 2020-11-20T12:13:52.998 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.987+0000 7fb084fe3700 1 Processor -- start 2020-11-20T12:13:52.998 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.987+0000 7fb084fe3700 1 -- start start 2020-11-20T12:13:53.001 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb084fe3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800630e0 0x7fb08013ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.002 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb084fe3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0800ba4e0 0x7fb080160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.002 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb084fe3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0800c3d00 0x7fb080144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.002 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb084fe3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801613c0 con 0x7fb0800630e0 2020-11-20T12:13:53.003 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb084fe3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080145850 con 0x7fb0800c3d00 2020-11-20T12:13:53.003 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb084fe3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801616c0 con 0x7fb0800ba4e0 2020-11-20T12:13:53.004 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800630e0 0x7fb08013ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.004 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800630e0 0x7fb08013ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36816/0 (socket says 172.21.15.134:36816) 2020-11-20T12:13:53.004 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 -- 172.21.15.134:0/2648323231 learned_addr learned my addr 172.21.15.134:0/2648323231 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.004 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07ed9d700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0800c3d00 0x7fb080144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.005 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 -- 172.21.15.134:0/2648323231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0800ba4e0 msgr2=0x7fb080160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.005 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0800ba4e0 0x7fb080160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:53.005 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 -- 172.21.15.134:0/2648323231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0800c3d00 msgr2=0x7fb080144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.006 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0800c3d00 0x7fb080144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.006 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 -- 172.21.15.134:0/2648323231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb080161960 con 0x7fb0800630e0 2020-11-20T12:13:53.006 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07ed9d700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0800c3d00 0x7fb080144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:13:53.006 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb07e59c700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800630e0 0x7fb08013ccb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb07800cb10 tx=0x7fb0780013b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.007 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb0767fc700 1 -- 172.21.15.134:0/2648323231 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078005b80 con 0x7fb0800630e0 2020-11-20T12:13:53.007 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb0767fc700 1 -- 172.21.15.134:0/2648323231 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb078005ce0 con 0x7fb0800630e0 2020-11-20T12:13:53.007 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb0767fc700 1 -- 172.21.15.134:0/2648323231 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078007340 con 0x7fb0800630e0 2020-11-20T12:13:53.007 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.988+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb080161c00 con 0x7fb0800630e0 2020-11-20T12:13:53.008 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.989+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb080162140 con 0x7fb0800630e0 2020-11-20T12:13:53.008 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.989+0000 7fb0767fc700 1 -- 172.21.15.134:0/2648323231 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fb078010030 con 0x7fb0800630e0 2020-11-20T12:13:53.008 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.989+0000 7fb0767fc700 1 -- 172.21.15.134:0/2648323231 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fb07800ab60 con 0x7fb0800630e0 2020-11-20T12:13:53.008 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.990+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb080069460 con 0x7fb0800630e0 2020-11-20T12:13:53.009 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:52.993+0000 7fb0767fc700 1 -- 172.21.15.134:0/2648323231 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fb07800ad70 con 0x7fb0800630e0 2020-11-20T12:13:53.088 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.085+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4766f07e-9808-49dc-b08e-8abda95ac061", "id": 4} v 0) v1 -- 0x7fb0801414f0 con 0x7fb0800630e0 2020-11-20T12:13:53.092 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.089+0000 7fb0767fc700 1 -- 172.21.15.134:0/2648323231 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4766f07e-9808-49dc-b08e-8abda95ac061", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb07800a560 con 0x7fb0800630e0 2020-11-20T12:13:53.092 INFO:teuthology.orchestra.run.smithi134.stdout:4 2020-11-20T12:13:53.094 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800630e0 msgr2=0x7fb08013ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.094 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800630e0 0x7fb08013ccb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fb07800cb10 tx=0x7fb0780013b0).stop 2020-11-20T12:13:53.094 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 shutdown_connections 2020-11-20T12:13:53.095 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb0800c3d00 0x7fb080144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.095 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0800630e0 0x7fb08013ccb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.095 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 --2- 172.21.15.134:0/2648323231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0800ba4e0 0x7fb080160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:53.096 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 >> 172.21.15.134:0/2648323231 conn(0x7fb080060140 msgr2=0x7fb080065040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.096 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 shutdown_connections 2020-11-20T12:13:53.096 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.090+0000 7fb084fe3700 1 -- 172.21.15.134:0/2648323231 wait complete. 2020-11-20T12:13:53.105 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 4ad696e2-6079-4d68-a4d4-820e0f60dc30 5 2020-11-20T12:13:53.227 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.224+0000 7fc6e1943700 1 Processor -- start 2020-11-20T12:13:53.227 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.224+0000 7fc6e1943700 1 -- start start 2020-11-20T12:13:53.229 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.224+0000 7fc6e1943700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6dc0c3170 0x7fc6dc0c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.229 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.224+0000 7fc6e1943700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc6dc0baef0 0x7fc6dc151e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.230 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.224+0000 7fc6e1943700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc0bca10 con 0x7fc6dc0bc580 2020-11-20T12:13:53.230 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.224+0000 7fc6e1943700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc0bcf50 con 0x7fc6dc0c3170 2020-11-20T12:13:53.230 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.224+0000 7fc6e1943700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc0bccb0 con 0x7fc6dc0baef0 2020-11-20T12:13:53.230 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6dc0c3170 0x7fc6dc0c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.231 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc6dc0c3170 0x7fc6dc0c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36822/0 (socket says 172.21.15.134:36822) 2020-11-20T12:13:53.231 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 -- 172.21.15.134:0/346257051 learned_addr learned my addr 172.21.15.134:0/346257051 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.231 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 -- 172.21.15.134:0/346257051 >> v2:172.21.15.160:3300/0 conn(0x7fc6dc0baef0 msgr2=0x7fc6dc151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:53.231 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 --2- 172.21.15.134:0/346257051 >> v2:172.21.15.160:3300/0 conn(0x7fc6dc0baef0 0x7fc6dc151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:53.231 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 -- 172.21.15.134:0/346257051 >> v1:172.21.15.150:6789/0 conn(0x7fc6dc0bc580 legacy=0x7fc6dc0c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.232 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 -- 172.21.15.134:0/346257051 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc151430 con 0x7fc6dc0c3170 2020-11-20T12:13:53.232 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6daffd700 1 --2- 172.21.15.134:0/346257051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc0c3550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc6dc067330 tx=0x7fc6d4009290).ready entity=mon.0 client_cookie=bba9cd46232609c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.232 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6d9ffb700 1 -- 172.21.15.134:0/346257051 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d400bc50 con 0x7fc6dc0c3170 2020-11-20T12:13:53.232 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6d9ffb700 1 -- 172.21.15.134:0/346257051 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d400bdb0 con 0x7fc6dc0c3170 2020-11-20T12:13:53.232 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.225+0000 7fc6d9ffb700 1 -- 172.21.15.134:0/346257051 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4011610 con 0x7fc6dc0c3170 2020-11-20T12:13:53.233 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 -- 172.21.15.134:0/346257051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 msgr2=0x7fc6dc0c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.233 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 --2- 172.21.15.134:0/346257051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc0c3550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc6dc067330 tx=0x7fc6d4009290).stop 2020-11-20T12:13:53.233 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 -- 172.21.15.134:0/346257051 shutdown_connections 2020-11-20T12:13:53.233 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 --2- 172.21.15.134:0/346257051 >> v2:172.21.15.160:3300/0 conn(0x7fc6dc0baef0 0x7fc6dc151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:53.234 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 --2- 172.21.15.134:0/346257051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc0c3550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.234 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 -- 172.21.15.134:0/346257051 >> 172.21.15.134:0/346257051 conn(0x7fc6dc060140 msgr2=0x7fc6dc060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.234 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 -- 172.21.15.134:0/346257051 shutdown_connections 2020-11-20T12:13:53.234 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.226+0000 7fc6e1943700 1 -- 172.21.15.134:0/346257051 wait complete. 2020-11-20T12:13:53.236 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.227+0000 7fc6e1943700 1 Processor -- start 2020-11-20T12:13:53.237 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.227+0000 7fc6e1943700 1 -- start start 2020-11-20T12:13:53.237 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc0baef0 0x7fc6dc150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.237 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc1404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.237 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6dc13ed50 0x7fc6dc161df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc134990 con 0x7fc6dc0c3170 2020-11-20T12:13:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc13fca0 con 0x7fc6dc0baef0 2020-11-20T12:13:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc13ff40 con 0x7fc6dc13ed50 2020-11-20T12:13:53.238 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6da7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc1404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6daffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc0baef0 0x7fc6dc150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6da7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc1404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36830/0 (socket says 172.21.15.134:36830) 2020-11-20T12:13:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6da7fc700 1 -- 172.21.15.134:0/106354394 learned_addr learned my addr 172.21.15.134:0/106354394 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6db7fe700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6dc13ed50 0x7fc6dc161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.239 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6daffd700 1 -- 172.21.15.134:0/106354394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6dc13ed50 msgr2=0x7fc6dc161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6daffd700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6dc13ed50 0x7fc6dc161df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6daffd700 1 -- 172.21.15.134:0/106354394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 msgr2=0x7fc6dc1404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6daffd700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc1404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6daffd700 1 -- 172.21.15.134:0/106354394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc1401e0 con 0x7fc6dc0baef0 2020-11-20T12:13:53.240 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6da7fc700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc1404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:53.241 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6daffd700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc0baef0 0x7fc6dc150b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc6dc067330 tx=0x7fc6d4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.241 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6c2ffd700 1 -- 172.21.15.134:0/106354394 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d401b5e0 con 0x7fc6dc0baef0 2020-11-20T12:13:53.241 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6c2ffd700 1 -- 172.21.15.134:0/106354394 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d401b740 con 0x7fc6dc0baef0 2020-11-20T12:13:53.241 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc1341b0 con 0x7fc6dc0baef0 2020-11-20T12:13:53.242 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6c2ffd700 1 -- 172.21.15.134:0/106354394 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d401bac0 con 0x7fc6dc0baef0 2020-11-20T12:13:53.242 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.228+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc1346f0 con 0x7fc6dc0baef0 2020-11-20T12:13:53.242 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.229+0000 7fc6c2ffd700 1 -- 172.21.15.134:0/106354394 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fc6d4017070 con 0x7fc6dc0baef0 2020-11-20T12:13:53.242 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.229+0000 7fc6c2ffd700 1 -- 172.21.15.134:0/106354394 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fc6d401ce00 con 0x7fc6dc0baef0 2020-11-20T12:13:53.242 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.229+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc069460 con 0x7fc6dc0baef0 2020-11-20T12:13:53.243 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.231+0000 7fc6c2ffd700 1 -- 172.21.15.134:0/106354394 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fc6d4015020 con 0x7fc6dc0baef0 2020-11-20T12:13:53.325 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.322+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4ad696e2-6079-4d68-a4d4-820e0f60dc30", "id": 5} v 0) v1 -- 0x7fc6dc068760 con 0x7fc6dc0baef0 2020-11-20T12:13:53.330 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.327+0000 7fc6c2ffd700 1 -- 172.21.15.134:0/106354394 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ad696e2-6079-4d68-a4d4-820e0f60dc30", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc6d401c860 con 0x7fc6dc0baef0 2020-11-20T12:13:53.330 INFO:teuthology.orchestra.run.smithi134.stdout:5 2020-11-20T12:13:53.331 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc0baef0 msgr2=0x7fc6dc150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.332 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc0baef0 0x7fc6dc150b50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fc6dc067330 tx=0x7fc6d4016000).stop 2020-11-20T12:13:53.332 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 shutdown_connections 2020-11-20T12:13:53.332 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6dc13ed50 0x7fc6dc161df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.332 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc6dc0baef0 0x7fc6dc150b50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.332 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 --2- 172.21.15.134:0/106354394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6dc0c3170 0x7fc6dc1404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.333 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 >> 172.21.15.134:0/106354394 conn(0x7fc6dc060140 msgr2=0x7fc6dc062f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.333 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 shutdown_connections 2020-11-20T12:13:53.333 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.328+0000 7fc6e1943700 1 -- 172.21.15.134:0/106354394 wait complete. 2020-11-20T12:13:53.342 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 68ef137b-dfa9-44ff-8de5-17008704111d 6 2020-11-20T12:13:53.464 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.461+0000 7f313170a700 1 Processor -- start 2020-11-20T12:13:53.465 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.461+0000 7f313170a700 1 -- start start 2020-11-20T12:13:53.467 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f313170a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f312c152f80 0x7f312c065c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.467 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f313170a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f312c0bd3d0 0x7f312c0bff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.468 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f313170a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c0c3050 con 0x7f312c065890 2020-11-20T12:13:53.468 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f313170a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0c32f0 con 0x7f312c152f80 2020-11-20T12:13:53.468 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f313170a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0c3590 con 0x7f312c0bd3d0 2020-11-20T12:13:53.468 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f312a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f312c152f80 0x7f312c065c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.469 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f312a7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f312c152f80 0x7f312c065c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.134:55580/0 (socket says 172.21.15.134:55580) 2020-11-20T12:13:53.469 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f312a7fc700 1 -- 172.21.15.134:0/2494841585 learned_addr learned my addr 172.21.15.134:0/2494841585 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.469 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f312b7fe700 1 --2- 172.21.15.134:0/2494841585 >> v2:172.21.15.160:3300/0 conn(0x7f312c0bd3d0 0x7f312c0bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.469 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f312a7fc700 1 -- 172.21.15.134:0/2494841585 >> v2:172.21.15.160:3300/0 conn(0x7f312c0bd3d0 msgr2=0x7f312c0bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:53.470 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.462+0000 7f312a7fc700 1 --2- 172.21.15.134:0/2494841585 >> v2:172.21.15.160:3300/0 conn(0x7f312c0bd3d0 0x7f312c0bff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.470 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f312a7fc700 1 -- 172.21.15.134:0/2494841585 >> v1:172.21.15.150:6789/0 conn(0x7f312c065890 legacy=0x7f312c152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.470 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f312a7fc700 1 -- 172.21.15.134:0/2494841585 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c0c3830 con 0x7f312c152f80 2020-11-20T12:13:53.470 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f312a7fc700 1 --2- 172.21.15.134:0/2494841585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c152f80 0x7f312c065c70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f312c0bf3a0 tx=0x7f3120006eb0).ready entity=mon.1 client_cookie=6db65c1687d7dac9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.470 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f3129ffb700 1 -- 172.21.15.134:0/2494841585 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31200098d0 con 0x7f312c152f80 2020-11-20T12:13:53.471 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f3129ffb700 1 -- 172.21.15.134:0/2494841585 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3120009a30 con 0x7f312c152f80 2020-11-20T12:13:53.471 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f3129ffb700 1 -- 172.21.15.134:0/2494841585 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3120009db0 con 0x7f312c152f80 2020-11-20T12:13:53.471 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 -- 172.21.15.134:0/2494841585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c152f80 msgr2=0x7f312c065c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.471 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 --2- 172.21.15.134:0/2494841585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c152f80 0x7f312c065c70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f312c0bf3a0 tx=0x7f3120006eb0).stop 2020-11-20T12:13:53.471 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 -- 172.21.15.134:0/2494841585 shutdown_connections 2020-11-20T12:13:53.472 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 --2- 172.21.15.134:0/2494841585 >> v2:172.21.15.160:3300/0 conn(0x7f312c0bd3d0 0x7f312c0bff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.472 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 --2- 172.21.15.134:0/2494841585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c152f80 0x7f312c065c70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.472 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 -- 172.21.15.134:0/2494841585 >> 172.21.15.134:0/2494841585 conn(0x7f312c060140 msgr2=0x7f312c060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.472 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 -- 172.21.15.134:0/2494841585 shutdown_connections 2020-11-20T12:13:53.473 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.463+0000 7f313170a700 1 -- 172.21.15.134:0/2494841585 wait complete. 2020-11-20T12:13:53.475 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 Processor -- start 2020-11-20T12:13:53.475 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 -- start start 2020-11-20T12:13:53.475 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c065890 0x7f312c155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.476 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f312c0bd3d0 0x7f312c15f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.476 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f312c152f80 0x7f312c10e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.476 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c15f000 con 0x7f312c152f80 2020-11-20T12:13:53.476 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c10d820 con 0x7f312c065890 2020-11-20T12:13:53.476 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.465+0000 7f313170a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c1562c0 con 0x7f312c0bd3d0 2020-11-20T12:13:53.477 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f312c152f80 0x7f312c10e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.477 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f312c152f80 0x7f312c10e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36844/0 (socket says 172.21.15.134:36844) 2020-11-20T12:13:53.477 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312b7fe700 1 -- 172.21.15.134:0/3371135349 learned_addr learned my addr 172.21.15.134:0/3371135349 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.478 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312affd700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c065890 0x7f312c155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.478 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312a7fc700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f312c0bd3d0 0x7f312c15f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.478 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312affd700 1 -- 172.21.15.134:0/3371135349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f312c0bd3d0 msgr2=0x7f312c15f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.478 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312affd700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f312c0bd3d0 0x7f312c15f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.479 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312affd700 1 -- 172.21.15.134:0/3371135349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f312c152f80 msgr2=0x7f312c10e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.479 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312affd700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f312c152f80 0x7f312c10e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.479 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312affd700 1 -- 172.21.15.134:0/3371135349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c10da50 con 0x7f312c065890 2020-11-20T12:13:53.479 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312b7fe700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f312c152f80 0x7f312c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:53.480 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f312affd700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c065890 0x7f312c155c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f312400ca90 tx=0x7f3124007ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.480 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f3112ffd700 1 -- 172.21.15.134:0/3371135349 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400a730 con 0x7f312c065890 2020-11-20T12:13:53.480 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f3112ffd700 1 -- 172.21.15.134:0/3371135349 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312400a890 con 0x7f312c065890 2020-11-20T12:13:53.481 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c10dcf0 con 0x7f312c065890 2020-11-20T12:13:53.481 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f3112ffd700 1 -- 172.21.15.134:0/3371135349 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312400ac10 con 0x7f312c065890 2020-11-20T12:13:53.481 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c10e230 con 0x7f312c065890 2020-11-20T12:13:53.482 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f3112ffd700 1 -- 172.21.15.134:0/3371135349 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f3124019030 con 0x7f312c065890 2020-11-20T12:13:53.482 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.466+0000 7f3112ffd700 1 -- 172.21.15.134:0/3371135349 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f312401ce20 con 0x7f312c065890 2020-11-20T12:13:53.483 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.467+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c10e430 con 0x7f312c065890 2020-11-20T12:13:53.483 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.469+0000 7f3112ffd700 1 -- 172.21.15.134:0/3371135349 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f312c10e430 con 0x7f312c065890 2020-11-20T12:13:53.565 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.561+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "68ef137b-dfa9-44ff-8de5-17008704111d", "id": 6} v 0) v1 -- 0x7f312c065db0 con 0x7f312c065890 2020-11-20T12:13:53.569 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.566+0000 7f3112ffd700 1 -- 172.21.15.134:0/3371135349 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68ef137b-dfa9-44ff-8de5-17008704111d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3124021060 con 0x7f312c065890 2020-11-20T12:13:53.570 INFO:teuthology.orchestra.run.smithi134.stdout:6 2020-11-20T12:13:53.571 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c065890 msgr2=0x7f312c155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.571 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c065890 0x7f312c155c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f312400ca90 tx=0x7f3124007ed0).stop 2020-11-20T12:13:53.571 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 shutdown_connections 2020-11-20T12:13:53.571 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f312c152f80 0x7f312c10e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.571 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f312c065890 0x7f312c155c00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.572 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 --2- 172.21.15.134:0/3371135349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f312c0bd3d0 0x7f312c15f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.572 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 >> 172.21.15.134:0/3371135349 conn(0x7f312c060140 msgr2=0x7f312c05ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.572 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 shutdown_connections 2020-11-20T12:13:53.572 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.567+0000 7f313170a700 1 -- 172.21.15.134:0/3371135349 wait complete. 2020-11-20T12:13:53.582 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 2ccbc6ef-df7b-476a-93b4-2557d2b0c120 7 2020-11-20T12:13:53.707 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.703+0000 7fd3542f1700 1 Processor -- start 2020-11-20T12:13:53.707 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.704+0000 7fd3542f1700 1 -- start start 2020-11-20T12:13:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.704+0000 7fd3542f1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd34c0c21d0 0x7fd34c0621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.704+0000 7fd3542f1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd34c0631f0 0x7fd34c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.704+0000 7fd3542f1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c154a30 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.704+0000 7fd3542f1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c154cd0 con 0x7fd34c0c21d0 2020-11-20T12:13:53.710 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.704+0000 7fd3542f1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c154f70 con 0x7fd34c0631f0 2020-11-20T12:13:53.711 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35188c700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd34c0c21d0 0x7fd34c0621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.711 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35208d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd34c0c3ff0 0x7fd34c151630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49614/0 (socket says 172.21.15.134:49614) 2020-11-20T12:13:53.711 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35208d700 1 -- 172.21.15.134:0/3991371521 learned_addr learned my addr 172.21.15.134:0/3991371521 (peer_addr_for_me v1:172.21.15.134:0/0) 2020-11-20T12:13:53.711 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35288e700 1 --2- 172.21.15.134:0/3991371521 >> v2:172.21.15.150:3300/0 conn(0x7fd34c0631f0 0x7fd34c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.711 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35188c700 1 -- 172.21.15.134:0/3991371521 >> v2:172.21.15.150:3300/0 conn(0x7fd34c0631f0 msgr2=0x7fd34c1543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:53.712 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35188c700 1 --2- 172.21.15.134:0/3991371521 >> v2:172.21.15.150:3300/0 conn(0x7fd34c0631f0 0x7fd34c1543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.712 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35188c700 1 -- 172.21.15.134:0/3991371521 >> v1:172.21.15.134:6789/0 conn(0x7fd34c0c3ff0 legacy=0x7fd34c151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.712 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35188c700 1 -- 172.21.15.134:0/3991371521 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c155210 con 0x7fd34c0c21d0 2020-11-20T12:13:53.712 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35108b700 1 -- 172.21.15.134:0/3991371521 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011818760 0 0) 0x7fd34c154a30 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.712 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35188c700 1 --2- 172.21.15.134:0/3991371521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c21d0 0x7fd34c0621a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd33c00b9a0 tx=0x7fd33c006df0).ready entity=mon.0 client_cookie=a088695bb55af8ce server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.713 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35108b700 1 -- 172.21.15.134:0/3991371521 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c009770 con 0x7fd34c0c21d0 2020-11-20T12:13:53.713 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35108b700 1 -- 172.21.15.134:0/3991371521 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c0098d0 con 0x7fd34c0c21d0 2020-11-20T12:13:53.713 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.705+0000 7fd35108b700 1 -- 172.21.15.134:0/3991371521 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c009c50 con 0x7fd34c0c21d0 2020-11-20T12:13:53.713 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 -- 172.21.15.134:0/3991371521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c21d0 msgr2=0x7fd34c0621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.713 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 --2- 172.21.15.134:0/3991371521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c21d0 0x7fd34c0621a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fd33c00b9a0 tx=0x7fd33c006df0).stop 2020-11-20T12:13:53.714 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 -- 172.21.15.134:0/3991371521 shutdown_connections 2020-11-20T12:13:53.714 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 --2- 172.21.15.134:0/3991371521 >> v2:172.21.15.150:3300/0 conn(0x7fd34c0631f0 0x7fd34c1543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.714 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 --2- 172.21.15.134:0/3991371521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c21d0 0x7fd34c0621a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.714 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 -- 172.21.15.134:0/3991371521 >> 172.21.15.134:0/3991371521 conn(0x7fd34c0616b0 msgr2=0x7fd34c061a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.714 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 -- 172.21.15.134:0/3991371521 shutdown_connections 2020-11-20T12:13:53.715 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.706+0000 7fd3542f1700 1 -- 172.21.15.134:0/3991371521 wait complete. 2020-11-20T12:13:53.717 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.707+0000 7fd3542f1700 1 Processor -- start 2020-11-20T12:13:53.717 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.707+0000 7fd3542f1700 1 -- start start 2020-11-20T12:13:53.717 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd34c0631f0 0x7fd34c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.718 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c0c21d0 0x7fd34c1125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.718 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c3ff0 0x7fd34c163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.718 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c152a10 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.718 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c160460 con 0x7fd34c0631f0 2020-11-20T12:13:53.718 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c160700 con 0x7fd34c0c21d0 2020-11-20T12:13:53.719 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c3ff0 0x7fd34c163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.719 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c3ff0 0x7fd34c163ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36856/0 (socket says 172.21.15.134:36856) 2020-11-20T12:13:53.719 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 -- 172.21.15.134:0/1795398507 learned_addr learned my addr 172.21.15.134:0/1795398507 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.719 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35208d700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd34c0631f0 0x7fd34c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.720 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 -- 172.21.15.134:0/1795398507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c0c21d0 msgr2=0x7fd34c1125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.720 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c0c21d0 0x7fd34c1125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:53.720 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 -- 172.21.15.134:0/1795398507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd34c0631f0 msgr2=0x7fd34c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.720 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd34c0631f0 0x7fd34c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.720 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 -- 172.21.15.134:0/1795398507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c1609a0 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.721 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd35288e700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c3ff0 0x7fd34c163ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd34400ef50 tx=0x7fd3440091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.721 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd33a7fc700 1 -- 172.21.15.134:0/1795398507 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34400cbf0 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.721 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd33a7fc700 1 -- 172.21.15.134:0/1795398507 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34400cd50 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.721 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c160c40 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.721 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd33a7fc700 1 -- 172.21.15.134:0/1795398507 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344012620 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.722 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c163640 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.722 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd33a7fc700 1 -- 172.21.15.134:0/1795398507 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fd344022070 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.722 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.708+0000 7fd33a7fc700 1 -- 172.21.15.134:0/1795398507 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fd34401bc20 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.722 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.709+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c069460 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.722 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.711+0000 7fd33a7fc700 1 -- 172.21.15.134:0/1795398507 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fd34403a880 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.807 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.802+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2ccbc6ef-df7b-476a-93b4-2557d2b0c120", "id": 7} v 0) v1 -- 0x7fd34c063ac0 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.810 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.805+0000 7fd33a7fc700 1 -- 172.21.15.134:0/1795398507 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ccbc6ef-df7b-476a-93b4-2557d2b0c120", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd344029030 con 0x7fd34c0c3ff0 2020-11-20T12:13:53.810 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c3ff0 msgr2=0x7fd34c163ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.810 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c3ff0 0x7fd34c163ae0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd34400ef50 tx=0x7fd3440091d0).stop 2020-11-20T12:13:53.811 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 shutdown_connections 2020-11-20T12:13:53.811 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd34c0c3ff0 0x7fd34c163ae0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.811 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd34c0631f0 0x7fd34c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.811 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 --2- 172.21.15.134:0/1795398507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c0c21d0 0x7fd34c1125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:53.811 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 >> 172.21.15.134:0/1795398507 conn(0x7fd34c0616b0 msgr2=0x7fd34c14fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.812 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 shutdown_connections 2020-11-20T12:13:53.812 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.806+0000 7fd3542f1700 1 -- 172.21.15.134:0/1795398507 wait complete. 2020-11-20T12:13:53.812 INFO:teuthology.orchestra.run.smithi134.stdout:7 2020-11-20T12:13:53.820 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5 8 2020-11-20T12:13:53.943 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.940+0000 7f9262478700 1 Processor -- start 2020-11-20T12:13:53.943 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.940+0000 7f9262478700 1 -- start start 2020-11-20T12:13:53.945 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9262478700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f925c061870 0x7f925c061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9262478700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c065dc0 con 0x7f925c0bcf40 2020-11-20T12:13:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9262478700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0bbae0 con 0x7f925c0bb650 2020-11-20T12:13:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9262478700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c0bbd80 con 0x7f925c061870 2020-11-20T12:13:53.946 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261476700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f925c061870 0x7f925c061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261476700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f925c061870 0x7f925c061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.134:55602/0 (socket says 172.21.15.134:55602) 2020-11-20T12:13:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261476700 1 -- 172.21.15.134:0/3321861695 learned_addr learned my addr 172.21.15.134:0/3321861695 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261c77700 1 --1- 172.21.15.134:0/3321861695 >> v1:172.21.15.150:6789/0 conn(0x7f925c0bcf40 0x7f925c0656b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.134:59464/0 (socket says 172.21.15.134:59464) 2020-11-20T12:13:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261476700 1 -- 172.21.15.134:0/3321861695 >> v1:172.21.15.160:6789/0 conn(0x7f925c0bb650 legacy=0x7f925c064fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:53.947 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261476700 1 -- 172.21.15.134:0/3321861695 >> v1:172.21.15.150:6789/0 conn(0x7f925c0bcf40 legacy=0x7f925c0656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261476700 1 -- 172.21.15.134:0/3321861695 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0bc560 con 0x7f925c061870 2020-11-20T12:13:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f9261476700 1 --2- 172.21.15.134:0/3321861695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c061870 0x7f925c061c50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f925800b8d0 tx=0x7f9258006e80).ready entity=mon.1 client_cookie=75437470ea173c31 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.941+0000 7f924bfff700 1 -- 172.21.15.134:0/3321861695 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800a910 con 0x7f925c061870 2020-11-20T12:13:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f924bfff700 1 -- 172.21.15.134:0/3321861695 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800aa70 con 0x7f925c061870 2020-11-20T12:13:53.948 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f924bfff700 1 -- 172.21.15.134:0/3321861695 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800adf0 con 0x7f925c061870 2020-11-20T12:13:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f9262478700 1 -- 172.21.15.134:0/3321861695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c061870 msgr2=0x7f925c061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f9262478700 1 --2- 172.21.15.134:0/3321861695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c061870 0x7f925c061c50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f925800b8d0 tx=0x7f9258006e80).stop 2020-11-20T12:13:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f9262478700 1 -- 172.21.15.134:0/3321861695 shutdown_connections 2020-11-20T12:13:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f9262478700 1 --2- 172.21.15.134:0/3321861695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c061870 0x7f925c061c50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.949 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f9262478700 1 -- 172.21.15.134:0/3321861695 >> 172.21.15.134:0/3321861695 conn(0x7f925c060140 msgr2=0x7f925c060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:53.950 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f9262478700 1 -- 172.21.15.134:0/3321861695 shutdown_connections 2020-11-20T12:13:53.950 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.942+0000 7f9262478700 1 -- 172.21.15.134:0/3321861695 wait complete. 2020-11-20T12:13:53.952 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.943+0000 7f9262478700 1 Processor -- start 2020-11-20T12:13:53.952 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.943+0000 7f9262478700 1 -- start start 2020-11-20T12:13:53.952 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9262478700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c0bcf40 0x7f925c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.953 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9262478700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f925c14e700 0x7f925c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.953 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9262478700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f925c14c440 0x7f925c1436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:53.953 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9262478700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c14ee10 con 0x7f925c14e700 2020-11-20T12:13:53.953 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9262478700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c150ff0 con 0x7f925c0bcf40 2020-11-20T12:13:53.953 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9262478700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c15cca0 con 0x7f925c14c440 2020-11-20T12:13:53.954 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9260c75700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f925c14e700 0x7f925c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.954 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9261476700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c0bcf40 0x7f925c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:53.954 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9260c75700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f925c14e700 0x7f925c15d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36866/0 (socket says 172.21.15.134:36866) 2020-11-20T12:13:53.954 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9260c75700 1 -- 172.21.15.134:0/3835792490 learned_addr learned my addr 172.21.15.134:0/3835792490 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:53.954 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.944+0000 7f9260c75700 1 -- 172.21.15.134:0/3835792490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f925c14c440 msgr2=0x7f925c1436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.955 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9260c75700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f925c14c440 0x7f925c1436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:53.955 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9260c75700 1 -- 172.21.15.134:0/3835792490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c0bcf40 msgr2=0x7f925c14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:53.955 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9260c75700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c0bcf40 0x7f925c14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:53.955 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9260c75700 1 -- 172.21.15.134:0/3835792490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c15ca00 con 0x7f925c14e700 2020-11-20T12:13:53.955 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9261476700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c0bcf40 0x7f925c14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:13:53.956 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9260c75700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f925c14e700 0x7f925c15d190 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f924c00c730 tx=0x7f924c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:53.956 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f92497fa700 1 -- 172.21.15.134:0/3835792490 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00e560 con 0x7f925c14e700 2020-11-20T12:13:53.956 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f92497fa700 1 -- 172.21.15.134:0/3835792490 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c00e6e0 con 0x7f925c14e700 2020-11-20T12:13:53.956 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c14eff0 con 0x7f925c14e700 2020-11-20T12:13:53.956 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f92497fa700 1 -- 172.21.15.134:0/3835792490 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c00eaa0 con 0x7f925c14e700 2020-11-20T12:13:53.957 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c14f530 con 0x7f925c14e700 2020-11-20T12:13:53.957 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f92497fa700 1 -- 172.21.15.134:0/3835792490 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f924c019030 con 0x7f925c14e700 2020-11-20T12:13:53.957 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.945+0000 7f92497fa700 1 -- 172.21.15.134:0/3835792490 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f924c01ce20 con 0x7f925c14e700 2020-11-20T12:13:53.957 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.946+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c044f60 con 0x7f925c14e700 2020-11-20T12:13:53.958 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:53.949+0000 7f92497fa700 1 -- 172.21.15.134:0/3835792490 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f924c021060 con 0x7f925c14e700 2020-11-20T12:13:54.042 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.039+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5", "id": 8} v 0) v1 -- 0x7f925c060dc0 con 0x7f925c14e700 2020-11-20T12:13:54.046 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.043+0000 7f92497fa700 1 -- 172.21.15.134:0/3835792490 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f924c02a0b0 con 0x7f925c14e700 2020-11-20T12:13:54.047 INFO:teuthology.orchestra.run.smithi134.stdout:8 2020-11-20T12:13:54.048 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f925c14e700 msgr2=0x7f925c15d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.048 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f925c14e700 0x7f925c15d190 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f924c00c730 tx=0x7f924c007c30).stop 2020-11-20T12:13:54.048 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 shutdown_connections 2020-11-20T12:13:54.049 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f925c14c440 0x7f925c1436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:54.049 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f925c0bcf40 0x7f925c14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.049 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 --2- 172.21.15.134:0/3835792490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f925c14e700 0x7f925c15d190 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.049 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 >> 172.21.15.134:0/3835792490 conn(0x7f925c060140 msgr2=0x7f925c0c2050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:54.049 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 shutdown_connections 2020-11-20T12:13:54.050 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.044+0000 7f9262478700 1 -- 172.21.15.134:0/3835792490 wait complete. 2020-11-20T12:13:54.059 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 3e6b4d8b-aa11-45ae-a917-b52b3893997b 9 2020-11-20T12:13:54.184 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.181+0000 7fe82791c700 1 Processor -- start 2020-11-20T12:13:54.184 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.181+0000 7fe82791c700 1 -- start start 2020-11-20T12:13:54.186 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe82791c700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8200c3d00 0x7fe8200634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe82791c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe8200ba4e0 0x7fe820151460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe82791c700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8200bbd30 con 0x7fe8200630e0 2020-11-20T12:13:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe82791c700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe820151950 con 0x7fe8200c3d00 2020-11-20T12:13:54.187 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe82791c700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82014d4b0 con 0x7fe8200ba4e0 2020-11-20T12:13:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8200c3d00 0x7fe8200634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe8200c3d00 0x7fe8200634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.134:55616/0 (socket says 172.21.15.134:55616) 2020-11-20T12:13:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 -- 172.21.15.134:0/2516024534 learned_addr learned my addr 172.21.15.134:0/2516024534 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe8256b8700 1 --1- 172.21.15.134:0/2516024534 >> v1:172.21.15.150:6789/0 conn(0x7fe8200630e0 0x7fe82014de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.134:59472/0 (socket says 172.21.15.134:59472) 2020-11-20T12:13:54.188 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe825eb9700 1 --2- 172.21.15.134:0/2516024534 >> v2:172.21.15.160:3300/0 conn(0x7fe8200ba4e0 0x7fe820151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 -- 172.21.15.134:0/2516024534 >> v2:172.21.15.160:3300/0 conn(0x7fe8200ba4e0 msgr2=0x7fe820151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 --2- 172.21.15.134:0/2516024534 >> v2:172.21.15.160:3300/0 conn(0x7fe8200ba4e0 0x7fe820151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 -- 172.21.15.134:0/2516024534 >> v1:172.21.15.150:6789/0 conn(0x7fe8200630e0 legacy=0x7fe82014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe813fff700 1 -- 172.21.15.134:0/2516024534 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802814040 0 0) 0x7fe8200bbd30 con 0x7fe8200630e0 2020-11-20T12:13:54.189 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 -- 172.21.15.134:0/2516024534 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8200bbf90 con 0x7fe8200c3d00 2020-11-20T12:13:54.190 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.182+0000 7fe824eb7700 1 --2- 172.21.15.134:0/2516024534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200c3d00 0x7fe8200634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe8200bdaf0 tx=0x7fe814006f40).ready entity=mon.1 client_cookie=de58e424c2745642 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:54.190 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe813fff700 1 -- 172.21.15.134:0/2516024534 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400cb30 con 0x7fe8200c3d00 2020-11-20T12:13:54.190 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe813fff700 1 -- 172.21.15.134:0/2516024534 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81400cc90 con 0x7fe8200c3d00 2020-11-20T12:13:54.190 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe813fff700 1 -- 172.21.15.134:0/2516024534 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814010620 con 0x7fe8200c3d00 2020-11-20T12:13:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 -- 172.21.15.134:0/2516024534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200c3d00 msgr2=0x7fe8200634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 --2- 172.21.15.134:0/2516024534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200c3d00 0x7fe8200634c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe8200bdaf0 tx=0x7fe814006f40).stop 2020-11-20T12:13:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 -- 172.21.15.134:0/2516024534 shutdown_connections 2020-11-20T12:13:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 --2- 172.21.15.134:0/2516024534 >> v2:172.21.15.160:3300/0 conn(0x7fe8200ba4e0 0x7fe820151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.191 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 --2- 172.21.15.134:0/2516024534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200c3d00 0x7fe8200634c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 -- 172.21.15.134:0/2516024534 >> 172.21.15.134:0/2516024534 conn(0x7fe820060140 msgr2=0x7fe820060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 -- 172.21.15.134:0/2516024534 shutdown_connections 2020-11-20T12:13:54.192 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.183+0000 7fe82791c700 1 -- 172.21.15.134:0/2516024534 wait complete. 2020-11-20T12:13:54.194 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.184+0000 7fe82791c700 1 Processor -- start 2020-11-20T12:13:54.194 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.184+0000 7fe82791c700 1 -- start start 2020-11-20T12:13:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe82791c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200630e0 0x7fe82014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe82791c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8200ba4e0 0x7fe820146e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe82791c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8200c3d00 0x7fe8200c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.195 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe82791c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe820164450 con 0x7fe8200c3d00 2020-11-20T12:13:54.196 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe82791c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201641b0 con 0x7fe8200630e0 2020-11-20T12:13:54.196 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe82791c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe820160150 con 0x7fe8200ba4e0 2020-11-20T12:13:54.196 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe825eb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8200c3d00 0x7fe8200c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.196 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe8256b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200630e0 0x7fe82014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.196 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe8256b8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200630e0 0x7fe82014ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.134:55620/0 (socket says 172.21.15.134:55620) 2020-11-20T12:13:54.197 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe825eb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8200c3d00 0x7fe8200c0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36880/0 (socket says 172.21.15.134:36880) 2020-11-20T12:13:54.197 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.185+0000 7fe8256b8700 1 -- 172.21.15.134:0/2951589752 learned_addr learned my addr 172.21.15.134:0/2951589752 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:54.197 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8256b8700 1 -- 172.21.15.134:0/2951589752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8200ba4e0 msgr2=0x7fe820146e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.197 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8256b8700 1 --2- 172.21.15.134:0/2951589752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8200ba4e0 0x7fe820146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:54.197 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8256b8700 1 -- 172.21.15.134:0/2951589752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8200c3d00 msgr2=0x7fe8200c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.198 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8256b8700 1 --2- 172.21.15.134:0/2951589752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8200c3d00 0x7fe8200c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.198 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8256b8700 1 -- 172.21.15.134:0/2951589752 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8201603f0 con 0x7fe8200630e0 2020-11-20T12:13:54.198 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8256b8700 1 --2- 172.21.15.134:0/2951589752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200630e0 0x7fe82014ce80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe81800cae0 tx=0x7fe818001380).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:54.198 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8117fa700 1 -- 172.21.15.134:0/2951589752 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818005ac0 con 0x7fe8200630e0 2020-11-20T12:13:54.199 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8117fa700 1 -- 172.21.15.134:0/2951589752 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818005c20 con 0x7fe8200630e0 2020-11-20T12:13:54.199 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe820160690 con 0x7fe8200630e0 2020-11-20T12:13:54.199 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe8117fa700 1 -- 172.21.15.134:0/2951589752 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818007110 con 0x7fe8200630e0 2020-11-20T12:13:54.199 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.186+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe820160dd0 con 0x7fe8200630e0 2020-11-20T12:13:54.199 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.187+0000 7fe8117fa700 1 -- 172.21.15.134:0/2951589752 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7fe818010030 con 0x7fe8200630e0 2020-11-20T12:13:54.200 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.187+0000 7fe8117fa700 1 -- 172.21.15.134:0/2951589752 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7fe81803cc20 con 0x7fe8200630e0 2020-11-20T12:13:54.200 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.187+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe820069460 con 0x7fe8200630e0 2020-11-20T12:13:54.200 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.190+0000 7fe8117fa700 1 -- 172.21.15.134:0/2951589752 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fe818011360 con 0x7fe8200630e0 2020-11-20T12:13:54.282 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.279+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3e6b4d8b-aa11-45ae-a917-b52b3893997b", "id": 9} v 0) v1 -- 0x7fe820068760 con 0x7fe8200630e0 2020-11-20T12:13:54.287 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.284+0000 7fe8117fa700 1 -- 172.21.15.134:0/2951589752 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e6b4d8b-aa11-45ae-a917-b52b3893997b", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe81803b0b0 con 0x7fe8200630e0 2020-11-20T12:13:54.287 INFO:teuthology.orchestra.run.smithi134.stdout:9 2020-11-20T12:13:54.288 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200630e0 msgr2=0x7fe82014ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.289 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 --2- 172.21.15.134:0/2951589752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200630e0 0x7fe82014ce80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe81800cae0 tx=0x7fe818001380).stop 2020-11-20T12:13:54.289 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 shutdown_connections 2020-11-20T12:13:54.289 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 --2- 172.21.15.134:0/2951589752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8200c3d00 0x7fe8200c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.289 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 --2- 172.21.15.134:0/2951589752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8200630e0 0x7fe82014ce80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.290 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 --2- 172.21.15.134:0/2951589752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8200ba4e0 0x7fe820146e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:54.290 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 >> 172.21.15.134:0/2951589752 conn(0x7fe820060140 msgr2=0x7fe8200beb80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:54.290 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 shutdown_connections 2020-11-20T12:13:54.290 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.285+0000 7fe82791c700 1 -- 172.21.15.134:0/2951589752 wait complete. 2020-11-20T12:13:54.299 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c447a333-a662-470d-9ba6-31bbca719e98 10 2020-11-20T12:13:54.415 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.412+0000 7eff88e9f700 1 Processor -- start 2020-11-20T12:13:54.415 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.412+0000 7eff88e9f700 1 -- start start 2020-11-20T12:13:54.418 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff88e9f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7eff84065810 0x7eff84065bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.419 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff88e9f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7eff84152970 0x7eff84152de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.419 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff88e9f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff841532d0 con 0x7eff8414bdb0 2020-11-20T12:13:54.419 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff88e9f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840bf7d0 con 0x7eff84152970 2020-11-20T12:13:54.419 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff88e9f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff840bffe0 con 0x7eff84065810 2020-11-20T12:13:54.420 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff81d9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7eff84152970 0x7eff84152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.420 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff82d9d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7eff8414bdb0 0x7eff8414c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49650/0 (socket says 172.21.15.134:49650) 2020-11-20T12:13:54.421 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff82d9d700 1 -- 172.21.15.134:0/1078707676 learned_addr learned my addr 172.21.15.134:0/1078707676 (peer_addr_for_me v1:172.21.15.134:0/0) 2020-11-20T12:13:54.421 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff81d9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7eff84152970 0x7eff84152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36882/0 (socket says 172.21.15.134:36882) 2020-11-20T12:13:54.421 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff8259c700 1 --2- 172.21.15.134:0/1078707676 >> v2:172.21.15.150:3300/0 conn(0x7eff84065810 0x7eff84065bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.421 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff81d9b700 1 -- 172.21.15.134:0/1078707676 >> v2:172.21.15.150:3300/0 conn(0x7eff84065810 msgr2=0x7eff84065bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:54.422 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff81d9b700 1 --2- 172.21.15.134:0/1078707676 >> v2:172.21.15.150:3300/0 conn(0x7eff84065810 0x7eff84065bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.422 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff81d9b700 1 -- 172.21.15.134:0/1078707676 >> v1:172.21.15.134:6789/0 conn(0x7eff8414bdb0 legacy=0x7eff8414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.422 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff81d9b700 1 -- 172.21.15.134:0/1078707676 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff840c0280 con 0x7eff84152970 2020-11-20T12:13:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff8159a700 1 -- 172.21.15.134:0/1078707676 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222763082 0 0) 0x7eff841532d0 con 0x7eff8414bdb0 2020-11-20T12:13:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff81d9b700 1 --2- 172.21.15.134:0/1078707676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84152970 0x7eff84152de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7eff840661f0 tx=0x7eff74006df0).ready entity=mon.0 client_cookie=658c13038839f9eb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.413+0000 7eff8159a700 1 -- 172.21.15.134:0/1078707676 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740097b0 con 0x7eff84152970 2020-11-20T12:13:54.423 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff8159a700 1 -- 172.21.15.134:0/1078707676 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff74009910 con 0x7eff84152970 2020-11-20T12:13:54.424 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff8159a700 1 -- 172.21.15.134:0/1078707676 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74009c90 con 0x7eff84152970 2020-11-20T12:13:54.424 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 -- 172.21.15.134:0/1078707676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84152970 msgr2=0x7eff84152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.424 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 --2- 172.21.15.134:0/1078707676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84152970 0x7eff84152de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7eff840661f0 tx=0x7eff74006df0).stop 2020-11-20T12:13:54.424 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 -- 172.21.15.134:0/1078707676 shutdown_connections 2020-11-20T12:13:54.425 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 --2- 172.21.15.134:0/1078707676 >> v2:172.21.15.150:3300/0 conn(0x7eff84065810 0x7eff84065bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.425 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 --2- 172.21.15.134:0/1078707676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84152970 0x7eff84152de0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.425 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 -- 172.21.15.134:0/1078707676 >> 172.21.15.134:0/1078707676 conn(0x7eff84060140 msgr2=0x7eff84060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:54.426 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 -- 172.21.15.134:0/1078707676 shutdown_connections 2020-11-20T12:13:54.426 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.414+0000 7eff88e9f700 1 -- 172.21.15.134:0/1078707676 wait complete. 2020-11-20T12:13:54.426 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.415+0000 7eff88e9f700 1 Processor -- start 2020-11-20T12:13:54.426 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.415+0000 7eff88e9f700 1 -- start start 2020-11-20T12:13:54.429 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84065810 0x7eff8415edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.430 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff8414bdb0 0x7eff84162160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.430 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84152970 0x7eff841475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.430 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8415e200 con 0x7eff84065810 2020-11-20T12:13:54.430 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff84162650 con 0x7eff84152970 2020-11-20T12:13:54.431 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff84143910 con 0x7eff8414bdb0 2020-11-20T12:13:54.431 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84065810 0x7eff8415edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.431 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84065810 0x7eff8415edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36886/0 (socket says 172.21.15.134:36886) 2020-11-20T12:13:54.432 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 -- 172.21.15.134:0/3889993861 learned_addr learned my addr 172.21.15.134:0/3889993861 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:54.432 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff82d9d700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84152970 0x7eff841475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.432 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 -- 172.21.15.134:0/3889993861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff8414bdb0 msgr2=0x7eff84162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.432 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff8414bdb0 0x7eff84162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:54.433 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 -- 172.21.15.134:0/3889993861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84152970 msgr2=0x7eff841475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.433 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84152970 0x7eff841475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.433 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 -- 172.21.15.134:0/3889993861 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84143bb0 con 0x7eff84065810 2020-11-20T12:13:54.434 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff8259c700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84065810 0x7eff8415edd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7eff7800db60 tx=0x7eff78008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:54.434 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff727fc700 1 -- 172.21.15.134:0/3889993861 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78009820 con 0x7eff84065810 2020-11-20T12:13:54.434 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff727fc700 1 -- 172.21.15.134:0/3889993861 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78009980 con 0x7eff84065810 2020-11-20T12:13:54.434 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8415e3f0 con 0x7eff84065810 2020-11-20T12:13:54.435 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff727fc700 1 -- 172.21.15.134:0/3889993861 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78009d20 con 0x7eff84065810 2020-11-20T12:13:54.435 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.416+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff84147aa0 con 0x7eff84065810 2020-11-20T12:13:54.435 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.417+0000 7eff727fc700 1 -- 172.21.15.134:0/3889993861 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7eff78013690 con 0x7eff84065810 2020-11-20T12:13:54.435 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.417+0000 7eff727fc700 1 -- 172.21.15.134:0/3889993861 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2280+0+0 (secure 0 0 0) 0x7eff7803d2f0 con 0x7eff84065810 2020-11-20T12:13:54.436 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.417+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff84151fb0 con 0x7eff84065810 2020-11-20T12:13:54.436 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.419+0000 7eff727fc700 1 -- 172.21.15.134:0/3889993861 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7eff7801d460 con 0x7eff84065810 2020-11-20T12:13:54.510 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.506+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c447a333-a662-470d-9ba6-31bbca719e98", "id": 10} v 0) v1 -- 0x7eff84069460 con 0x7eff84065810 2020-11-20T12:13:54.513 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.510+0000 7eff727fc700 1 -- 172.21.15.134:0/3889993861 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c447a333-a662-470d-9ba6-31bbca719e98", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7eff7802c0b0 con 0x7eff84065810 2020-11-20T12:13:54.513 INFO:teuthology.orchestra.run.smithi134.stdout:10 2020-11-20T12:13:54.515 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84065810 msgr2=0x7eff8415edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.516 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84065810 0x7eff8415edd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7eff7800db60 tx=0x7eff78008040).stop 2020-11-20T12:13:54.516 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 shutdown_connections 2020-11-20T12:13:54.516 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7eff84152970 0x7eff841475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.516 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff84065810 0x7eff8415edd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.517 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 --2- 172.21.15.134:0/3889993861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff8414bdb0 0x7eff84162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:54.517 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 >> 172.21.15.134:0/3889993861 conn(0x7eff84060140 msgr2=0x7eff840c1130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:54.517 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 shutdown_connections 2020-11-20T12:13:54.518 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.511+0000 7eff88e9f700 1 -- 172.21.15.134:0/3889993861 wait complete. 2020-11-20T12:13:54.525 INFO:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new ef60d791-08b7-4edc-991b-be018728ea35 11 2020-11-20T12:13:54.645 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.642+0000 7f400dcab700 1 Processor -- start 2020-11-20T12:13:54.646 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.642+0000 7f400dcab700 1 -- start start 2020-11-20T12:13:54.652 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f400dcab700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080bffe0 con 0x7f4008153080 2020-11-20T12:13:54.652 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f400dcab700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080c0280 con 0x7f4008065bf0 2020-11-20T12:13:54.653 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f400dcab700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080c0520 con 0x7f4008065810 2020-11-20T12:13:54.653 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f4006ffd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f4008153080 0x7f40080c2fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.134:49660/0 (socket says 172.21.15.134:49660) 2020-11-20T12:13:54.653 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f4006ffd700 1 -- 172.21.15.134:0/1595096797 learned_addr learned my addr 172.21.15.134:0/1595096797 (peer_addr_for_me v1:172.21.15.134:0/0) 2020-11-20T12:13:54.654 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659661284 0 0) 0x7f40080bffe0 con 0x7f4008153080 2020-11-20T12:13:54.654 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff4003240 con 0x7f4008153080 2020-11-20T12:13:54.654 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 439407364 0 0) 0x7f3ff4003240 con 0x7f4008153080 2020-11-20T12:13:54.654 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 >> v1:172.21.15.160:6789/0 conn(0x7f4008065810 legacy=0x7f4008152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:54.654 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 >> v1:172.21.15.150:6789/0 conn(0x7f4008065bf0 legacy=0x7f4008159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.655 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080c07c0 con 0x7f4008153080 2020-11-20T12:13:54.655 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.643+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f3ffc0014e0 con 0x7f4008153080 2020-11-20T12:13:54.655 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 >> v1:172.21.15.134:6789/0 conn(0x7f4008153080 legacy=0x7f40080c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.655 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ff4003760 0x7f3ff4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.656 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40044e0 0x7f3ff4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.656 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4004e50 0x7f3ff400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.656 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff4004250 con 0x7f3ff4003760 2020-11-20T12:13:54.656 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff400bc20 con 0x7f3ff4004e50 2020-11-20T12:13:54.657 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff400bd60 con 0x7f3ff40044e0 2020-11-20T12:13:54.657 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40077fe700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ff4003760 0x7f3ff4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.657 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f4007fff700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4004e50 0x7f3ff400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.657 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40077fe700 1 -- 172.21.15.134:0/1595096797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40044e0 msgr2=0x7f3ff4004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:54.658 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40077fe700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff40044e0 0x7f3ff4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:13:54.658 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40077fe700 1 -- 172.21.15.134:0/1595096797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4004e50 msgr2=0x7f3ff400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:54.658 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40077fe700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4004e50 0x7f3ff400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.658 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40077fe700 1 -- 172.21.15.134:0/1595096797 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4003240 con 0x7f3ff4003760 2020-11-20T12:13:54.659 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f4007fff700 1 -- 172.21.15.134:0/1595096797 reap_dead start 2020-11-20T12:13:54.659 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40077fe700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ff4003760 0x7f3ff4003b40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3ff8001830 tx=0x7f3ff8007b70).ready entity=mon.0 client_cookie=29e1f7113cbfcc2c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:54.659 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800c830 con 0x7f3ff4003760 2020-11-20T12:13:54.659 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff800c9d0 con 0x7f3ff4003760 2020-11-20T12:13:54.659 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.644+0000 7f40067fc700 1 -- 172.21.15.134:0/1595096797 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff800cd90 con 0x7f3ff4003760 2020-11-20T12:13:54.660 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.645+0000 7f400dcab700 1 -- 172.21.15.134:0/1595096797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ff4003760 msgr2=0x7f3ff4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.660 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.645+0000 7f400dcab700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ff4003760 0x7f3ff4003b40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3ff8001830 tx=0x7f3ff8007b70).stop 2020-11-20T12:13:54.660 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.645+0000 7f400dcab700 1 -- 172.21.15.134:0/1595096797 shutdown_connections 2020-11-20T12:13:54.661 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.645+0000 7f400dcab700 1 --2- 172.21.15.134:0/1595096797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ff4003760 0x7f3ff4003b40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.661 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.645+0000 7f400dcab700 1 -- 172.21.15.134:0/1595096797 >> 172.21.15.134:0/1595096797 conn(0x7f4008060140 msgr2=0x7f4008060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:54.661 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.645+0000 7f400dcab700 1 -- 172.21.15.134:0/1595096797 shutdown_connections 2020-11-20T12:13:54.661 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.645+0000 7f400dcab700 1 -- 172.21.15.134:0/1595096797 wait complete. 2020-11-20T12:13:54.662 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.646+0000 7f400dcab700 1 Processor -- start 2020-11-20T12:13:54.662 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.646+0000 7f400dcab700 1 -- start start 2020-11-20T12:13:54.662 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4003760 0x7f400814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.663 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4008110330 0x7f40080bdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.663 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080be020 0x7f400815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:54.663 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008161240 con 0x7f4008110330 2020-11-20T12:13:54.663 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008110830 con 0x7f40080be020 2020-11-20T12:13:54.664 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008110ad0 con 0x7f3ff4003760 2020-11-20T12:13:54.664 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4008110330 0x7f40080bdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.664 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4008110330 0x7f40080bdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:36904/0 (socket says 172.21.15.134:36904) 2020-11-20T12:13:54.664 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 -- 172.21.15.134:0/3689892029 learned_addr learned my addr 172.21.15.134:0/3689892029 (peer_addr_for_me v2:172.21.15.134:0/0) 2020-11-20T12:13:54.665 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f40077fe700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4003760 0x7f400814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.665 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4007fff700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080be020 0x7f400815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:54.666 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 -- 172.21.15.134:0/3689892029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4003760 msgr2=0x7f400814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.667 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4003760 0x7f400814b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.667 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 -- 172.21.15.134:0/3689892029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080be020 msgr2=0x7f400815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.668 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080be020 0x7f400815dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.668 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 -- 172.21.15.134:0/3689892029 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008161470 con 0x7f4008110330 2020-11-20T12:13:54.668 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f4006ffd700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4008110330 0x7f40080bdb30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3ffc00ca60 tx=0x7f40080c06b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:54.669 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f3fe77fe700 1 -- 172.21.15.134:0/3689892029 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc007170 con 0x7f4008110330 2020-11-20T12:13:54.669 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f3fe77fe700 1 -- 172.21.15.134:0/3689892029 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc0072f0 con 0x7f4008110330 2020-11-20T12:13:54.669 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f3fe77fe700 1 -- 172.21.15.134:0/3689892029 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc00aa40 con 0x7f4008110330 2020-11-20T12:13:54.669 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4008161710 con 0x7f4008110330 2020-11-20T12:13:54.670 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.647+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40080c38b0 con 0x7f4008110330 2020-11-20T12:13:54.670 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.648+0000 7f3fe77fe700 1 -- 172.21.15.134:0/3689892029 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7f3ffc010070 con 0x7f4008110330 2020-11-20T12:13:54.670 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.648+0000 7f3fe77fe700 1 -- 172.21.15.134:0/3689892029 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2419+0+0 (secure 0 0 0) 0x7f3ffc03c660 con 0x7f4008110330 2020-11-20T12:13:54.670 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.648+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4008161b70 con 0x7f4008110330 2020-11-20T12:13:54.671 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.650+0000 7f3fe77fe700 1 -- 172.21.15.134:0/3689892029 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f3ffc00ae30 con 0x7f4008110330 2020-11-20T12:13:54.742 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.739+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ef60d791-08b7-4edc-991b-be018728ea35", "id": 11} v 0) v1 -- 0x7f4008069460 con 0x7f4008110330 2020-11-20T12:13:54.745 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.742+0000 7f3fe77fe700 1 -- 172.21.15.134:0/3689892029 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef60d791-08b7-4edc-991b-be018728ea35", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f3ffc012b50 con 0x7f4008110330 2020-11-20T12:13:54.745 INFO:teuthology.orchestra.run.smithi134.stdout:11 2020-11-20T12:13:54.746 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4008110330 msgr2=0x7f40080bdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:54.747 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4008110330 0x7f40080bdb30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3ffc00ca60 tx=0x7f40080c06b0).stop 2020-11-20T12:13:54.747 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 shutdown_connections 2020-11-20T12:13:54.747 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f40080be020 0x7f400815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.747 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ff4003760 0x7f400814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.747 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 --2- 172.21.15.134:0/3689892029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4008110330 0x7f40080bdb30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:54.748 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 >> 172.21.15.134:0/3689892029 conn(0x7f4008060140 msgr2=0x7f400814e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:54.748 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 shutdown_connections 2020-11-20T12:13:54.748 INFO:teuthology.orchestra.run.smithi134.stderr:2020-11-20T12:13:54.743+0000 7f400dcab700 1 -- 172.21.15.134:0/3689892029 wait complete. 2020-11-20T12:13:54.757 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T12:13:54.758 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T12:13:54.765 INFO:tasks.ceph.osd.0:Started 2020-11-20T12:13:54.766 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T12:13:54.766 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T12:13:54.773 INFO:tasks.ceph.osd.3:Started 2020-11-20T12:13:54.773 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T12:13:54.773 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T12:13:54.779 INFO:tasks.ceph.osd.6:Started 2020-11-20T12:13:54.779 INFO:tasks.ceph.osd.9:Restarting daemon 2020-11-20T12:13:54.780 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2020-11-20T12:13:54.784 INFO:tasks.ceph.osd.9:Started 2020-11-20T12:13:54.784 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T12:13:54.785 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T12:13:54.787 INFO:tasks.ceph.osd.1:Started 2020-11-20T12:13:54.788 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T12:13:54.788 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T12:13:54.790 INFO:tasks.ceph.osd.4:Started 2020-11-20T12:13:54.790 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T12:13:54.791 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T12:13:54.792 INFO:tasks.ceph.osd.7:Started 2020-11-20T12:13:54.793 INFO:tasks.ceph.osd.10:Restarting daemon 2020-11-20T12:13:54.793 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2020-11-20T12:13:54.795 INFO:tasks.ceph.osd.10:Started 2020-11-20T12:13:54.795 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T12:13:54.796 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T12:13:54.798 INFO:tasks.ceph.osd.2:Started 2020-11-20T12:13:54.799 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T12:13:54.799 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T12:13:54.801 INFO:tasks.ceph.osd.5:Started 2020-11-20T12:13:54.801 INFO:tasks.ceph.osd.8:Restarting daemon 2020-11-20T12:13:54.802 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2020-11-20T12:13:54.804 INFO:tasks.ceph.osd.8:Started 2020-11-20T12:13:54.804 INFO:tasks.ceph.osd.11:Restarting daemon 2020-11-20T12:13:54.804 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2020-11-20T12:13:54.807 INFO:tasks.ceph.osd.11:Started 2020-11-20T12:13:54.807 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T12:13:54.868 INFO:tasks.ceph.osd.1.smithi150.stderr:2020-11-20T12:13:54.865+0000 7f9b91555ec0 -1 Falling back to public interface 2020-11-20T12:13:54.874 INFO:tasks.ceph.osd.10.smithi150.stderr:2020-11-20T12:13:54.871+0000 7f11d9dd6ec0 -1 Falling back to public interface 2020-11-20T12:13:54.878 INFO:tasks.ceph.osd.1.smithi150.stderr:2020-11-20T12:13:54.876+0000 7f9b91555ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.879 INFO:tasks.ceph.osd.1.smithi150.stderr:2020-11-20T12:13:54.876+0000 7f9b91555ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.879 INFO:tasks.ceph.osd.1.smithi150.stderr:2020-11-20T12:13:54.876+0000 7f9b91555ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.882 INFO:tasks.ceph.osd.2.smithi134.stderr:2020-11-20T12:13:54.879+0000 7fa60ac4bec0 -1 Falling back to public interface 2020-11-20T12:13:54.885 INFO:tasks.ceph.osd.1.smithi150.stderr:2020-11-20T12:13:54.882+0000 7f9b91555ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T12:13:54.889 INFO:tasks.ceph.osd.10.smithi150.stderr:2020-11-20T12:13:54.886+0000 7f11d9dd6ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.889 INFO:tasks.ceph.osd.10.smithi150.stderr:2020-11-20T12:13:54.886+0000 7f11d9dd6ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.890 INFO:tasks.ceph.osd.10.smithi150.stderr:2020-11-20T12:13:54.886+0000 7f11d9dd6ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.893 INFO:tasks.ceph.osd.8.smithi134.stderr:2020-11-20T12:13:54.890+0000 7fa7d9467ec0 -1 Falling back to public interface 2020-11-20T12:13:54.894 INFO:tasks.ceph.osd.2.smithi134.stderr:2020-11-20T12:13:54.890+0000 7fa60ac4bec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.894 INFO:tasks.ceph.osd.2.smithi134.stderr:2020-11-20T12:13:54.890+0000 7fa60ac4bec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.894 INFO:tasks.ceph.osd.2.smithi134.stderr:2020-11-20T12:13:54.890+0000 7fa60ac4bec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.898 INFO:tasks.ceph.osd.10.smithi150.stderr:2020-11-20T12:13:54.895+0000 7f11d9dd6ec0 -1 osd.10 0 log_to_monitors {default=true} 2020-11-20T12:13:54.900 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-11-20T12:13:54.898+0000 7fc8eba38ec0 -1 Falling back to public interface 2020-11-20T12:13:54.902 INFO:tasks.ceph.osd.2.smithi134.stderr:2020-11-20T12:13:54.899+0000 7fa60ac4bec0 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T12:13:54.903 INFO:tasks.ceph.osd.5.smithi134.stderr:2020-11-20T12:13:54.900+0000 7f4ecf930ec0 -1 Falling back to public interface 2020-11-20T12:13:54.904 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-11-20T12:13:54.901+0000 7ff875c94ec0 -1 Falling back to public interface 2020-11-20T12:13:54.908 INFO:tasks.ceph.osd.8.smithi134.stderr:2020-11-20T12:13:54.905+0000 7fa7d9467ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.908 INFO:tasks.ceph.osd.8.smithi134.stderr:2020-11-20T12:13:54.905+0000 7fa7d9467ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.909 INFO:tasks.ceph.osd.8.smithi134.stderr:2020-11-20T12:13:54.905+0000 7fa7d9467ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.909 INFO:tasks.ceph.osd.11.smithi134.stderr:2020-11-20T12:13:54.906+0000 7fe3ba645ec0 -1 Falling back to public interface 2020-11-20T12:13:54.915 INFO:tasks.ceph.osd.8.smithi134.stderr:2020-11-20T12:13:54.912+0000 7fa7d9467ec0 -1 osd.8 0 log_to_monitors {default=true} 2020-11-20T12:13:54.916 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-11-20T12:13:54.913+0000 7fc8eba38ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.916 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-11-20T12:13:54.913+0000 7fc8eba38ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.916 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-11-20T12:13:54.913+0000 7fc8eba38ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.920 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-11-20T12:13:54.916+0000 7ff875c94ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.920 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-11-20T12:13:54.917+0000 7ff875c94ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.920 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-11-20T12:13:54.917+0000 7ff875c94ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.921 INFO:tasks.ceph.osd.5.smithi134.stderr:2020-11-20T12:13:54.918+0000 7f4ecf930ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.922 INFO:tasks.ceph.osd.5.smithi134.stderr:2020-11-20T12:13:54.918+0000 7f4ecf930ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.922 INFO:tasks.ceph.osd.5.smithi134.stderr:2020-11-20T12:13:54.918+0000 7f4ecf930ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.923 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-11-20T12:13:54.919+0000 7fc8eba38ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T12:13:54.925 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-11-20T12:13:54.922+0000 7ff875c94ec0 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T12:13:54.928 INFO:tasks.ceph.osd.5.smithi134.stderr:2020-11-20T12:13:54.925+0000 7f4ecf930ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T12:13:54.929 INFO:tasks.ceph.osd.11.smithi134.stderr:2020-11-20T12:13:54.925+0000 7fe3ba645ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.929 INFO:tasks.ceph.osd.11.smithi134.stderr:2020-11-20T12:13:54.925+0000 7fe3ba645ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.929 INFO:tasks.ceph.osd.11.smithi134.stderr:2020-11-20T12:13:54.925+0000 7fe3ba645ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.935 INFO:tasks.ceph.osd.11.smithi134.stderr:2020-11-20T12:13:54.932+0000 7fe3ba645ec0 -1 osd.11 0 log_to_monitors {default=true} 2020-11-20T12:13:54.940 INFO:tasks.ceph.osd.3.smithi160.stderr:2020-11-20T12:13:54.937+0000 7fac81adcec0 -1 Falling back to public interface 2020-11-20T12:13:54.941 INFO:tasks.ceph.osd.0.smithi160.stderr:2020-11-20T12:13:54.938+0000 7fc4b9619ec0 -1 Falling back to public interface 2020-11-20T12:13:54.969 INFO:tasks.ceph.osd.0.smithi160.stderr:2020-11-20T12:13:54.965+0000 7fc4b9619ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.969 INFO:tasks.ceph.osd.0.smithi160.stderr:2020-11-20T12:13:54.965+0000 7fc4b9619ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.969 INFO:tasks.ceph.osd.0.smithi160.stderr:2020-11-20T12:13:54.965+0000 7fc4b9619ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.975 INFO:tasks.ceph.osd.3.smithi160.stderr:2020-11-20T12:13:54.972+0000 7fac81adcec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:54.975 INFO:tasks.ceph.osd.3.smithi160.stderr:2020-11-20T12:13:54.972+0000 7fac81adcec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.976 INFO:tasks.ceph.osd.3.smithi160.stderr:2020-11-20T12:13:54.972+0000 7fac81adcec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:54.979 INFO:tasks.ceph.osd.0.smithi160.stderr:2020-11-20T12:13:54.976+0000 7fc4b9619ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T12:13:54.990 INFO:tasks.ceph.osd.3.smithi160.stderr:2020-11-20T12:13:54.986+0000 7fac81adcec0 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T12:13:54.990 INFO:tasks.ceph.osd.6.smithi160.stderr:2020-11-20T12:13:54.986+0000 7fb5ebd6dec0 -1 Falling back to public interface 2020-11-20T12:13:54.991 INFO:tasks.ceph.osd.9.smithi160.stderr:2020-11-20T12:13:54.988+0000 7f3ffcbe3ec0 -1 Falling back to public interface 2020-11-20T12:13:55.025 INFO:tasks.ceph.osd.6.smithi160.stderr:2020-11-20T12:13:55.021+0000 7fb5ebd6dec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:55.025 INFO:tasks.ceph.osd.6.smithi160.stderr:2020-11-20T12:13:55.021+0000 7fb5ebd6dec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:55.025 INFO:tasks.ceph.osd.6.smithi160.stderr:2020-11-20T12:13:55.021+0000 7fb5ebd6dec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:55.026 INFO:tasks.ceph.osd.9.smithi160.stderr:2020-11-20T12:13:55.021+0000 7f3ffcbe3ec0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2020-11-20T12:13:55.026 INFO:tasks.ceph.osd.9.smithi160.stderr:2020-11-20T12:13:55.022+0000 7f3ffcbe3ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:55.026 INFO:tasks.ceph.osd.9.smithi160.stderr:2020-11-20T12:13:55.022+0000 7f3ffcbe3ec0 -1 journal do_read_entry(8192): bad header magic 2020-11-20T12:13:55.037 INFO:tasks.ceph.osd.6.smithi160.stderr:2020-11-20T12:13:55.034+0000 7fb5ebd6dec0 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T12:13:55.038 INFO:tasks.ceph.osd.9.smithi160.stderr:2020-11-20T12:13:55.034+0000 7f3ffcbe3ec0 -1 osd.9 0 log_to_monitors {default=true} 2020-11-20T12:13:56.011 INFO:teuthology.orchestra.run.smithi160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T12:13:56.481 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.477+0000 7f8e0b59e700 1 Processor -- start 2020-11-20T12:13:56.481 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.477+0000 7f8e0b59e700 1 -- start start 2020-11-20T12:13:56.482 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.479+0000 7f8e0b59e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c152b60 con 0x7f8e0c064c50 2020-11-20T12:13:56.482 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.479+0000 7f8e0b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0bbec0 con 0x7f8e0c065030 2020-11-20T12:13:56.483 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.479+0000 7f8e0b59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0bc160 con 0x7f8e0c152710 2020-11-20T12:13:56.484 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.480+0000 7f8e0a59c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f8e0c064c50 0x7f8e0c0bafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:59548/0 (socket says 172.21.15.160:59548) 2020-11-20T12:13:56.485 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.480+0000 7f8e0a59c700 1 -- 172.21.15.160:0/572611573 learned_addr learned my addr 172.21.15.160:0/572611573 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:13:56.485 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.480+0000 7f8e03fff700 1 --1- 172.21.15.160:0/572611573 >> v1:172.21.15.150:6789/0 conn(0x7f8e0c065030 0x7f8e0c152000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46086/0 (socket says 172.21.15.160:46086) 2020-11-20T12:13:56.485 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.480+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625789529 0 0) 0x7f8dfc0010d0 con 0x7f8e0c064c50 2020-11-20T12:13:56.486 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.480+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dec003240 con 0x7f8e0c064c50 2020-11-20T12:13:56.486 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633533182 0 0) 0x7f8e0c0bbec0 con 0x7f8e0c065030 2020-11-20T12:13:56.486 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dfc0010d0 con 0x7f8e0c065030 2020-11-20T12:13:56.486 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4244304457 0 0) 0x7f8dec003240 con 0x7f8e0c064c50 2020-11-20T12:13:56.487 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 >> v1:172.21.15.160:6789/0 conn(0x7f8e0c152710 legacy=0x7f8e0c061ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.487 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 >> v1:172.21.15.150:6789/0 conn(0x7f8e0c065030 legacy=0x7f8e0c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.487 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0bc400 con 0x7f8e0c064c50 2020-11-20T12:13:56.488 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f8dfc001670 con 0x7f8e0c064c50 2020-11-20T12:13:56.493 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 >> v1:172.21.15.134:6789/0 conn(0x7f8e0c064c50 legacy=0x7f8e0c0bafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.494 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dec003940 0x7f8dec003d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:56.494 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec0044e0 0x7f8dec004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:56.494 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dec004e50 0x7f8dec00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:56.495 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec00bc20 con 0x7f8dec003940 2020-11-20T12:13:56.495 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec00bd60 con 0x7f8dec0044e0 2020-11-20T12:13:56.495 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec00bef0 con 0x7f8dec004e50 2020-11-20T12:13:56.495 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e0a59c700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dec003940 0x7f8dec003d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:56.496 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e03fff700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec0044e0 0x7f8dec004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:56.496 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.481+0000 7f8e0ad9d700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dec004e50 0x7f8dec00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:56.496 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e0a59c700 1 -- 172.21.15.160:0/572611573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dec004e50 msgr2=0x7f8dec00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:56.497 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e0a59c700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dec004e50 0x7f8dec00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.497 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e0a59c700 1 -- 172.21.15.160:0/572611573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec0044e0 msgr2=0x7f8dec004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:13:56.497 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e0a59c700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec0044e0 0x7f8dec004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.498 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e0a59c700 1 -- 172.21.15.160:0/572611573 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec003240 con 0x7f8dec003940 2020-11-20T12:13:56.498 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e03fff700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec0044e0 0x7f8dec004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:13:56.498 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e0ad9d700 1 -- 172.21.15.160:0/572611573 reap_dead start 2020-11-20T12:13:56.499 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e0a59c700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dec003940 0x7f8dec003d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f8dfc00c3f0 tx=0x7f8e0c0bc590).ready entity=mon.0 client_cookie=9227f58f323789cc server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:56.499 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0072e0 con 0x7f8dec003940 2020-11-20T12:13:56.499 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc007480 con 0x7f8dec003940 2020-11-20T12:13:56.500 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.482+0000 7f8e09d9b700 1 -- 172.21.15.160:0/572611573 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc005820 con 0x7f8dec003940 2020-11-20T12:13:56.500 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.483+0000 7f8e0b59e700 1 -- 172.21.15.160:0/572611573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dec003940 msgr2=0x7f8dec003d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.500 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.483+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dec003940 0x7f8dec003d40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f8dfc00c3f0 tx=0x7f8e0c0bc590).stop 2020-11-20T12:13:56.500 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.483+0000 7f8e0b59e700 1 -- 172.21.15.160:0/572611573 shutdown_connections 2020-11-20T12:13:56.501 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.483+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/572611573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8dec003940 0x7f8dec003d40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.501 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.483+0000 7f8e0b59e700 1 -- 172.21.15.160:0/572611573 >> 172.21.15.160:0/572611573 conn(0x7f8e0c0c2f30 msgr2=0x7f8e0c0c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:56.502 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.483+0000 7f8e0b59e700 1 -- 172.21.15.160:0/572611573 shutdown_connections 2020-11-20T12:13:56.502 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.483+0000 7f8e0b59e700 1 -- 172.21.15.160:0/572611573 wait complete. 2020-11-20T12:13:56.502 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.484+0000 7f8e0b59e700 1 Processor -- start 2020-11-20T12:13:56.502 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.485+0000 7f8e0b59e700 1 -- start start 2020-11-20T12:13:56.503 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.485+0000 7f8e0b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec003940 0x7f8e0c0c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:56.503 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e0b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e0c0c05e0 0x7f8e0c148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:56.503 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e0b59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e0c148560 0x7f8e0c10fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:56.504 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e0b59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c1643b0 con 0x7f8e0c148560 2020-11-20T12:13:56.504 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e0b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c164650 con 0x7f8dec003940 2020-11-20T12:13:56.504 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e0b59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c1648f0 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.505 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e0c0c05e0 0x7f8e0c148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:56.505 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e0c0c05e0 0x7f8e0c148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37254/0 (socket says 172.21.15.160:37254) 2020-11-20T12:13:56.505 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 -- 172.21.15.160:0/3431805891 learned_addr learned my addr 172.21.15.160:0/3431805891 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:13:56.506 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e0a59c700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec003940 0x7f8e0c0c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:56.506 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e0ad9d700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e0c148560 0x7f8e0c10fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:56.507 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 -- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec003940 msgr2=0x7f8e0c0c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.507 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec003940 0x7f8e0c0c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.507 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 -- 172.21.15.160:0/3431805891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e0c148560 msgr2=0x7f8e0c10fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.508 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e0c148560 0x7f8e0c10fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.508 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.486+0000 7f8e03fff700 1 -- 172.21.15.160:0/3431805891 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c164b90 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.508 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.487+0000 7f8e03fff700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e0c0c05e0 0x7f8e0c148070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8df4001900 tx=0x7f8df4007dd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:56.509 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.487+0000 7f8e027fc700 1 -- 172.21.15.160:0/3431805891 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4001cd0 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.509 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.487+0000 7f8e027fc700 1 -- 172.21.15.160:0/3431805891 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400e860 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.509 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.487+0000 7f8e027fc700 1 -- 172.21.15.160:0/3431805891 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400ebe0 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.510 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.487+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c164e30 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.510 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.487+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c1489c0 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.510 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.488+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c165290 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.510 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.489+0000 7f8e027fc700 1 -- 172.21.15.160:0/3431805891 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 4) v1 ==== 101030+0+0 (secure 0 0 0) 0x7f8df4014430 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.511 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.490+0000 7f8e027fc700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8de8080550 0x7f8de8082a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:13:56.511 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.490+0000 7f8e027fc700 1 -- 172.21.15.160:0/3431805891 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2858+0+0 (secure 0 0 0) 0x7f8df40a1700 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.512 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.490+0000 7f8e0a59c700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8de8080550 0x7f8de8082a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:13:56.512 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.491+0000 7f8e0a59c700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8de8080550 0x7f8de8082a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f8dfc0010a0 tx=0x7f8dfc015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:13:56.513 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.494+0000 7f8e027fc700 1 -- 172.21.15.160:0/3431805891 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8df4077630 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.685 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.682+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e0c044f60 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.686 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.683+0000 7f8e027fc700 1 -- 172.21.15.160:0/3431805891 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11483 (secure 0 0 0) 0x7f8df407ac50 con 0x7f8e0c0c05e0 2020-11-20T12:13:56.687 INFO:teuthology.misc.health.smithi160.stdout: 2020-11-20T12:13:56.687 INFO:teuthology.misc.health.smithi160.stdout:{"epoch":15,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:13:55.742298+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:13:56.689 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8de8080550 msgr2=0x7f8de8082a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.689 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8de8080550 0x7f8de8082a10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f8dfc0010a0 tx=0x7f8dfc015000).stop 2020-11-20T12:13:56.690 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e0c0c05e0 msgr2=0x7f8e0c148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:13:56.690 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e0c0c05e0 0x7f8e0c148070 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f8df4001900 tx=0x7f8df4007dd0).stop 2020-11-20T12:13:56.691 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 shutdown_connections 2020-11-20T12:13:56.691 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8de8080550 0x7f8de8082a10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.692 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e0c148560 0x7f8e0c10fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.692 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8dec003940 0x7f8e0c0c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.692 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 --2- 172.21.15.160:0/3431805891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e0c0c05e0 0x7f8e0c148070 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:13:56.692 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 >> 172.21.15.160:0/3431805891 conn(0x7f8e0c0c2f30 msgr2=0x7f8e0c158320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:13:56.693 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 shutdown_connections 2020-11-20T12:13:56.693 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:13:56.686+0000 7f8e0b59e700 1 -- 172.21.15.160:0/3431805891 wait complete. 2020-11-20T12:13:56.708 DEBUG:teuthology.misc:0 of 12 OSDs are up 2020-11-20T12:13:56.757 INFO:tasks.ceph.osd.2.smithi134.stderr:2020-11-20T12:13:56.754+0000 7fa601c62700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T12:13:56.758 INFO:tasks.ceph.osd.1.smithi150.stderr:2020-11-20T12:13:56.755+0000 7f9b8856c700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T12:13:56.759 INFO:tasks.ceph.osd.5.smithi134.stderr:2020-11-20T12:13:56.755+0000 7f4ec6947700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T12:13:56.760 INFO:tasks.ceph.osd.11.smithi134.stderr:2020-11-20T12:13:56.755+0000 7fe3b165c700 -1 osd.11 0 waiting for initial osdmap 2020-11-20T12:13:56.764 INFO:tasks.ceph.osd.8.smithi134.stderr:2020-11-20T12:13:56.760+0000 7fa7d047e700 -1 osd.8 0 waiting for initial osdmap 2020-11-20T12:13:56.765 INFO:tasks.ceph.osd.4.smithi150.stderr:2020-11-20T12:13:56.759+0000 7fc8e2a4f700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T12:13:56.765 INFO:tasks.ceph.osd.10.smithi150.stderr:2020-11-20T12:13:56.760+0000 7f11d0ded700 -1 osd.10 0 waiting for initial osdmap 2020-11-20T12:13:56.766 INFO:tasks.ceph.osd.3.smithi160.stderr:2020-11-20T12:13:56.762+0000 7fac78af3700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T12:13:56.767 INFO:tasks.ceph.osd.7.smithi150.stderr:2020-11-20T12:13:56.761+0000 7ff86ccab700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T12:13:56.770 INFO:tasks.ceph.osd.6.smithi160.stderr:2020-11-20T12:13:56.766+0000 7fb5e2d84700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T12:13:56.777 INFO:tasks.ceph.osd.9.smithi160.stderr:2020-11-20T12:13:56.774+0000 7f3ff3bfa700 -1 osd.9 0 waiting for initial osdmap 2020-11-20T12:13:56.777 INFO:tasks.ceph.osd.0.smithi160.stderr:2020-11-20T12:13:56.774+0000 7fc4b0630700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T12:13:56.780 INFO:tasks.ceph.osd.3.smithi160.stderr:2020-11-20T12:13:56.777+0000 7fac74a72700 -1 osd.3 16 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2020-11-20T12:13:56.785 INFO:tasks.ceph.osd.6.smithi160.stderr:2020-11-20T12:13:56.782+0000 7fb5ded03700 -1 osd.6 16 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2020-11-20T12:13:56.790 INFO:tasks.ceph.osd.9.smithi160.stderr:2020-11-20T12:13:56.787+0000 7f3fefb79700 -1 osd.9 16 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2020-11-20T12:13:56.791 INFO:tasks.ceph.osd.0.smithi160.stderr:2020-11-20T12:13:56.787+0000 7fc4ac5af700 -1 osd.0 16 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2020-11-20T12:14:03.915 INFO:teuthology.orchestra.run.smithi160:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:04.125 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.121+0000 7f1e71a3a700 1 Processor -- start 2020-11-20T12:14:04.125 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.122+0000 7f1e71a3a700 1 -- start start 2020-11-20T12:14:04.127 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.123+0000 7f1e71a3a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1e6c0becb0 0x7f1e6c0bf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.127 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.123+0000 7f1e71a3a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1e6c14ba10 0x7f1e6c14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.127 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.123+0000 7f1e71a3a700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c14ec70 con 0x7f1e6c0ba370 2020-11-20T12:14:04.127 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.123+0000 7f1e71a3a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c14ef10 con 0x7f1e6c14ba10 2020-11-20T12:14:04.128 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.123+0000 7f1e71a3a700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c14f1b0 con 0x7f1e6c0becb0 2020-11-20T12:14:04.129 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.124+0000 7f1e6bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f1e6c14ba10 0x7f1e6c14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.130 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.124+0000 7f1e70a38700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1e6c0becb0 0x7f1e6c0bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.130 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.124+0000 7f1e71239700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f1e6c0ba370 0x7f1e6c0ba7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:59830/0 (socket says 172.21.15.160:59830) 2020-11-20T12:14:04.130 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.124+0000 7f1e71239700 1 -- 172.21.15.160:0/3562964497 learned_addr learned my addr 172.21.15.160:0/3562964497 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:04.130 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.124+0000 7f1e6b7fe700 1 -- 172.21.15.160:0/3562964497 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582607329 0 0) 0x7f1e6c14ec70 con 0x7f1e6c0ba370 2020-11-20T12:14:04.131 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.124+0000 7f1e6bfff700 1 -- 172.21.15.160:0/3562964497 >> v2:172.21.15.160:3300/0 conn(0x7f1e6c0becb0 msgr2=0x7f1e6c0bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:04.131 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.125+0000 7f1e6bfff700 1 --2- 172.21.15.160:0/3562964497 >> v2:172.21.15.160:3300/0 conn(0x7f1e6c0becb0 0x7f1e6c0bf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.131 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.125+0000 7f1e6bfff700 1 -- 172.21.15.160:0/3562964497 >> v1:172.21.15.134:6789/0 conn(0x7f1e6c0ba370 legacy=0x7f1e6c0ba7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.131 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.125+0000 7f1e6bfff700 1 -- 172.21.15.160:0/3562964497 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c14f450 con 0x7f1e6c14ba10 2020-11-20T12:14:04.131 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.125+0000 7f1e6bfff700 1 --2- 172.21.15.160:0/3562964497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c14ba10 0x7f1e6c14bea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1e6c0c0a60 tx=0x7f1e58006df0).ready entity=mon.0 client_cookie=80920a4c657e2d64 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:04.132 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.125+0000 7f1e6b7fe700 1 -- 172.21.15.160:0/3562964497 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58009840 con 0x7f1e6c14ba10 2020-11-20T12:14:04.132 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.125+0000 7f1e6b7fe700 1 -- 172.21.15.160:0/3562964497 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e580099a0 con 0x7f1e6c14ba10 2020-11-20T12:14:04.132 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.125+0000 7f1e6b7fe700 1 -- 172.21.15.160:0/3562964497 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e58009d20 con 0x7f1e6c14ba10 2020-11-20T12:14:04.132 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 -- 172.21.15.160:0/3562964497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c14ba10 msgr2=0x7f1e6c14bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.133 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/3562964497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c14ba10 0x7f1e6c14bea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f1e6c0c0a60 tx=0x7f1e58006df0).stop 2020-11-20T12:14:04.133 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 -- 172.21.15.160:0/3562964497 shutdown_connections 2020-11-20T12:14:04.133 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/3562964497 >> v2:172.21.15.160:3300/0 conn(0x7f1e6c0becb0 0x7f1e6c0bf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.133 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/3562964497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c14ba10 0x7f1e6c14bea0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0x7f1e6c0c0a60 tx=0x7f1e58006df0).stop 2020-11-20T12:14:04.133 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 -- 172.21.15.160:0/3562964497 >> 172.21.15.160:0/3562964497 conn(0x7f1e6c0c2f30 msgr2=0x7f1e6c0c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:04.134 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 -- 172.21.15.160:0/3562964497 shutdown_connections 2020-11-20T12:14:04.135 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.126+0000 7f1e71a3a700 1 -- 172.21.15.160:0/3562964497 wait complete. 2020-11-20T12:14:04.135 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.128+0000 7f1e71a3a700 1 Processor -- start 2020-11-20T12:14:04.136 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.128+0000 7f1e71a3a700 1 -- start start 2020-11-20T12:14:04.136 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e71a3a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c0ba370 0x7f1e6c14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.136 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e71a3a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c0becb0 0x7f1e6c160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.136 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e71a3a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e6c14e1d0 0x7f1e6c064ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.137 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e71a3a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c161000 con 0x7f1e6c0becb0 2020-11-20T12:14:04.137 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e71a3a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c14c590 con 0x7f1e6c14e1d0 2020-11-20T12:14:04.137 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e71a3a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1637a0 con 0x7f1e6c0ba370 2020-11-20T12:14:04.137 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c0ba370 0x7f1e6c14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.137 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c0ba370 0x7f1e6c14bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37526/0 (socket says 172.21.15.160:37526) 2020-11-20T12:14:04.139 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 -- 172.21.15.160:0/2987299361 learned_addr learned my addr 172.21.15.160:0/2987299361 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:04.140 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e6bfff700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c0becb0 0x7f1e6c160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.140 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e71239700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e6c14e1d0 0x7f1e6c064ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.140 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 -- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e6c14e1d0 msgr2=0x7f1e6c064ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.140 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e6c14e1d0 0x7f1e6c064ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.140 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 -- 172.21.15.160:0/2987299361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c0becb0 msgr2=0x7f1e6c160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.141 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c0becb0 0x7f1e6c160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.141 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e70a38700 1 -- 172.21.15.160:0/2987299361 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c163a40 con 0x7f1e6c0ba370 2020-11-20T12:14:04.141 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.129+0000 7f1e6bfff700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c0becb0 0x7f1e6c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:04.141 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.130+0000 7f1e70a38700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c0ba370 0x7f1e6c14bed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1e6000ec00 tx=0x7f1e60006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:04.142 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.130+0000 7f1e68ff9700 1 -- 172.21.15.160:0/2987299361 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000b960 con 0x7f1e6c0ba370 2020-11-20T12:14:04.142 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.130+0000 7f1e68ff9700 1 -- 172.21.15.160:0/2987299361 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6000bac0 con 0x7f1e6c0ba370 2020-11-20T12:14:04.142 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.130+0000 7f1e68ff9700 1 -- 172.21.15.160:0/2987299361 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6000be40 con 0x7f1e6c0ba370 2020-11-20T12:14:04.142 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.130+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c163ce0 con 0x7f1e6c0ba370 2020-11-20T12:14:04.142 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.130+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c164420 con 0x7f1e6c0ba370 2020-11-20T12:14:04.143 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.131+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c164140 con 0x7f1e6c0ba370 2020-11-20T12:14:04.143 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.133+0000 7f1e68ff9700 1 -- 172.21.15.160:0/2987299361 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1e60012600 con 0x7f1e6c0ba370 2020-11-20T12:14:04.143 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.134+0000 7f1e68ff9700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e44080630 0x7f1e44082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.143 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.134+0000 7f1e68ff9700 1 -- 172.21.15.160:0/2987299361 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f1e600a2710 con 0x7f1e6c0ba370 2020-11-20T12:14:04.144 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.134+0000 7f1e6bfff700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e44080630 0x7f1e44082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.144 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.135+0000 7f1e6bfff700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e44080630 0x7f1e44082af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1e6c14bdf0 tx=0x7f1e58015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:04.144 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.138+0000 7f1e68ff9700 1 -- 172.21.15.160:0/2987299361 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1e600777a0 con 0x7f1e6c0ba370 2020-11-20T12:14:04.329 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.325+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e6c044f60 con 0x7f1e6c0ba370 2020-11-20T12:14:04.331 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.327+0000 7f1e68ff9700 1 -- 172.21.15.160:0/2987299361 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16905 (secure 0 0 0) 0x7f1e6007adc0 con 0x7f1e6c0ba370 2020-11-20T12:14:04.338 INFO:teuthology.misc.health.smithi160.stdout: 2020-11-20T12:14:04.340 INFO:teuthology.misc.health.smithi160.stdout:{"epoch":19,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:13:59.788291+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:04.341 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e44080630 msgr2=0x7f1e44082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.341 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e44080630 0x7f1e44082af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1e6c14bdf0 tx=0x7f1e58015000).stop 2020-11-20T12:14:04.342 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c0ba370 msgr2=0x7f1e6c14bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.343 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c0ba370 0x7f1e6c14bed0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f1e6000ec00 tx=0x7f1e60006df0).stop 2020-11-20T12:14:04.344 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 shutdown_connections 2020-11-20T12:14:04.345 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e44080630 0x7f1e44082af0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.347 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e6c14e1d0 0x7f1e6c064ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.348 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c0ba370 0x7f1e6c14bed0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.348 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 --2- 172.21.15.160:0/2987299361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e6c0becb0 0x7f1e6c160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.349 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 >> 172.21.15.160:0/2987299361 conn(0x7f1e6c0c2f30 msgr2=0x7f1e6c148cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:04.349 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.330+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 shutdown_connections 2020-11-20T12:14:04.350 INFO:teuthology.misc.health.smithi160.stderr:2020-11-20T12:14:04.331+0000 7f1e71a3a700 1 -- 172.21.15.160:0/2987299361 wait complete. 2020-11-20T12:14:04.354 DEBUG:teuthology.misc:12 of 12 OSDs are up 2020-11-20T12:14:04.355 INFO:tasks.ceph:Creating RBD pool 2020-11-20T12:14:04.356 INFO:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T12:14:04.588 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.584+0000 7f3eb4685700 1 Processor -- start 2020-11-20T12:14:04.588 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.584+0000 7f3eb4685700 1 -- start start 2020-11-20T12:14:04.589 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.586+0000 7f3eb4685700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3eac0c0690 0x7f3eac065c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.590 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.586+0000 7f3eb4685700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0c3050 con 0x7f3eac152f80 2020-11-20T12:14:04.591 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.586+0000 7f3eb4685700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac0c32f0 con 0x7f3eac065890 2020-11-20T12:14:04.591 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.586+0000 7f3eb4685700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac0c3590 con 0x7f3eac0c0690 2020-11-20T12:14:04.591 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.586+0000 7f3eb2421700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f3eac065890 0x7f3eac152870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55114/0 (socket says 172.21.15.160:55114) 2020-11-20T12:14:04.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.586+0000 7f3eb1c20700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f3eac152f80 0x7f3eac0bff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:59844/0 (socket says 172.21.15.160:59844) 2020-11-20T12:14:04.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.586+0000 7f3eb2421700 1 -- 172.21.15.160:0/1806765104 learned_addr learned my addr 172.21.15.160:0/1806765104 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:04.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb2c22700 1 --2- 172.21.15.160:0/1806765104 >> v2:172.21.15.150:3300/0 conn(0x7f3eac0c0690 0x7f3eac065c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177548276 0 0) 0x7f3eac0c3050 con 0x7f3eac152f80 2020-11-20T12:14:04.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e94003240 con 0x7f3eac152f80 2020-11-20T12:14:04.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1726407570 0 0) 0x7f3e94003240 con 0x7f3eac152f80 2020-11-20T12:14:04.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 >> v2:172.21.15.150:3300/0 conn(0x7f3eac0c0690 msgr2=0x7f3eac065c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:04.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 --2- 172.21.15.160:0/1806765104 >> v2:172.21.15.150:3300/0 conn(0x7f3eac0c0690 0x7f3eac065c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 >> v1:172.21.15.160:6789/0 conn(0x7f3eac065890 legacy=0x7f3eac152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0c3830 con 0x7f3eac152f80 2020-11-20T12:14:04.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f3e9c0014e0 con 0x7f3eac152f80 2020-11-20T12:14:04.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 >> v1:172.21.15.134:6789/0 conn(0x7f3eac152f80 legacy=0x7f3eac0bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e94003730 0x7f3e94003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.600 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940044e0 0x7f3e94004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.600 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.587+0000 7f3eb141f700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94004e50 0x7f3e9400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.600 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0c3590 con 0x7f3e940044e0 2020-11-20T12:14:04.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94004220 con 0x7f3e94003730 2020-11-20T12:14:04.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9400bc20 con 0x7f3e94004e50 2020-11-20T12:14:04.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb1c20700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940044e0 0x7f3e94004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2421700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e94003730 0x7f3e94003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2c22700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94004e50 0x7f3e9400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2421700 1 -- 172.21.15.160:0/1806765104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94004e50 msgr2=0x7f3e9400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:04.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2421700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94004e50 0x7f3e9400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2421700 1 -- 172.21.15.160:0/1806765104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940044e0 msgr2=0x7f3e94004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:04.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2421700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940044e0 0x7f3e94004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2421700 1 -- 172.21.15.160:0/1806765104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e94003240 con 0x7f3e94003730 2020-11-20T12:14:04.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb1c20700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e940044e0 0x7f3e94004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:04.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.588+0000 7f3eb2c22700 1 -- 172.21.15.160:0/1806765104 reap_dead start 2020-11-20T12:14:04.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.589+0000 7f3eb2421700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e94003730 0x7f3e94003b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3ea8001ff0 tx=0x7f3ea8001610).ready entity=mon.1 client_cookie=65aea31441f01053 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:04.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.589+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80016a0 con 0x7f3e94003730 2020-11-20T12:14:04.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.589+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea8005b80 con 0x7f3e94003730 2020-11-20T12:14:04.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.589+0000 7f3eb141f700 1 -- 172.21.15.160:0/1806765104 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800c900 con 0x7f3e94003730 2020-11-20T12:14:04.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.590+0000 7f3eb4685700 1 -- 172.21.15.160:0/1806765104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e94003730 msgr2=0x7f3e94003b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.590+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e94003730 0x7f3e94003b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f3ea8001ff0 tx=0x7f3ea8001610).stop 2020-11-20T12:14:04.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.590+0000 7f3eb4685700 1 -- 172.21.15.160:0/1806765104 shutdown_connections 2020-11-20T12:14:04.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.590+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1806765104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e94003730 0x7f3e94003b10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.590+0000 7f3eb4685700 1 -- 172.21.15.160:0/1806765104 >> 172.21.15.160:0/1806765104 conn(0x7f3eac060140 msgr2=0x7f3eac060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:04.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.590+0000 7f3eb4685700 1 -- 172.21.15.160:0/1806765104 shutdown_connections 2020-11-20T12:14:04.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.590+0000 7f3eb4685700 1 -- 172.21.15.160:0/1806765104 wait complete. 2020-11-20T12:14:04.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.592+0000 7f3eb4685700 1 Processor -- start 2020-11-20T12:14:04.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.592+0000 7f3eb4685700 1 -- start start 2020-11-20T12:14:04.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.593+0000 7f3eb4685700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94003730 0x7f3eac0c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.593+0000 7f3eb4685700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eac0c27d0 0x7f3eac111f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.593+0000 7f3eb4685700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eac0bb360 0x7f3eac112470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.593+0000 7f3eb4685700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0bb8a0 con 0x7f3eac0bb360 2020-11-20T12:14:04.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.593+0000 7f3eb4685700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0bbb40 con 0x7f3eac0c27d0 2020-11-20T12:14:04.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.593+0000 7f3eb4685700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0bbde0 con 0x7f3e94003730 2020-11-20T12:14:04.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb2421700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94003730 0x7f3eac0c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb2421700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94003730 0x7f3eac0c22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37548/0 (socket says 172.21.15.160:37548) 2020-11-20T12:14:04.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb2421700 1 -- 172.21.15.160:0/1100561539 learned_addr learned my addr 172.21.15.160:0/1100561539 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:04.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb1c20700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eac0c27d0 0x7f3eac111f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb2c22700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eac0bb360 0x7f3eac112470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb1c20700 1 -- 172.21.15.160:0/1100561539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94003730 msgr2=0x7f3eac0c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb1c20700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94003730 0x7f3eac0c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb1c20700 1 -- 172.21.15.160:0/1100561539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eac0bb360 msgr2=0x7f3eac112470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:04.611 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb1c20700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eac0bb360 0x7f3eac112470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:04.611 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb1c20700 1 -- 172.21.15.160:0/1100561539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac0bc080 con 0x7f3eac0c27d0 2020-11-20T12:14:04.611 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.594+0000 7f3eb2c22700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eac0bb360 0x7f3eac112470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:04.611 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.595+0000 7f3eb1c20700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eac0c27d0 0x7f3eac111f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3e9c004ba0 tx=0x7f3eac0c3480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:04.611 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.595+0000 7f3e9a7fc700 1 -- 172.21.15.160:0/1100561539 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00f9f0 con 0x7f3eac0c27d0 2020-11-20T12:14:04.612 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.595+0000 7f3e9a7fc700 1 -- 172.21.15.160:0/1100561539 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00fb50 con 0x7f3eac0c27d0 2020-11-20T12:14:04.612 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.595+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eac0bc320 con 0x7f3eac0c27d0 2020-11-20T12:14:04.612 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.595+0000 7f3e9a7fc700 1 -- 172.21.15.160:0/1100561539 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00fed0 con 0x7f3eac0c27d0 2020-11-20T12:14:04.612 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.595+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac161030 con 0x7f3eac0c27d0 2020-11-20T12:14:04.613 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.596+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac0bedb0 con 0x7f3eac0c27d0 2020-11-20T12:14:04.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.597+0000 7f3e9a7fc700 1 -- 172.21.15.160:0/1100561539 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3e9c012560 con 0x7f3eac0c27d0 2020-11-20T12:14:04.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.598+0000 7f3e9a7fc700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3e84080630 0x7f3e84082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:04.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.598+0000 7f3e9a7fc700 1 -- 172.21.15.160:0/1100561539 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f3e9c0a1c90 con 0x7f3eac0c27d0 2020-11-20T12:14:04.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.599+0000 7f3eb2421700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3e84080630 0x7f3e84082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:04.615 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.599+0000 7f3eb2421700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3e84080630 0x7f3e84082af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3ea80021f0 tx=0x7f3ea8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:04.615 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.603+0000 7f3e9a7fc700 1 -- 172.21.15.160:0/1100561539 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3e9c076cc0 con 0x7f3eac0c27d0 2020-11-20T12:14:04.793 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:04.789+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f3eac153970 con 0x7f3eac0c27d0 2020-11-20T12:14:05.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.153+0000 7f3e9a7fc700 1 -- 172.21.15.160:0/1100561539 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3e9c019030 con 0x7f3eac0c27d0 2020-11-20T12:14:05.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3e84080630 msgr2=0x7f3e84082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:05.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3e84080630 0x7f3e84082af0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3ea80021f0 tx=0x7f3ea8015000).stop 2020-11-20T12:14:05.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eac0c27d0 msgr2=0x7f3eac111f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:05.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eac0c27d0 0x7f3eac111f80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3e9c004ba0 tx=0x7f3eac0c3480).stop 2020-11-20T12:14:05.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 shutdown_connections 2020-11-20T12:14:05.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3e84080630 0x7f3e84082af0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:05.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3eac0bb360 0x7f3eac112470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:05.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e94003730 0x7f3eac0c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:05.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 --2- 172.21.15.160:0/1100561539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3eac0c27d0 0x7f3eac111f80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:05.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.157+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 >> 172.21.15.160:0/1100561539 conn(0x7f3eac060140 msgr2=0x7f3eac152790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:05.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.158+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 shutdown_connections 2020-11-20T12:14:05.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.158+0000 7f3eb4685700 1 -- 172.21.15.160:0/1100561539 wait complete. 2020-11-20T12:14:05.166 INFO:teuthology.orchestra.run.smithi160.stderr:pool 'rbd' created 2020-11-20T12:14:05.190 INFO:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T12:14:05.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.427+0000 7f311ccb9700 1 Processor -- start 2020-11-20T12:14:05.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.427+0000 7f311ccb9700 1 -- start start 2020-11-20T12:14:05.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.428+0000 7f311ccb9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3118062380 0x7f31180ba0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:05.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.428+0000 7f311ccb9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180bd020 con 0x7f31181507c0 2020-11-20T12:14:05.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.428+0000 7f311ccb9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180bd2c0 con 0x7f311814d470 2020-11-20T12:14:05.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.428+0000 7f311ccb9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31180bba80 con 0x7f3118062380 2020-11-20T12:14:05.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.429+0000 7f31177fe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f31181507c0 0x7f3118150ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:59862/0 (socket says 172.21.15.160:59862) 2020-11-20T12:14:05.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.429+0000 7f31177fe700 1 -- 172.21.15.160:0/1412350004 learned_addr learned my addr 172.21.15.160:0/1412350004 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:05.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.429+0000 7f310effd700 1 --2- 172.21.15.160:0/1412350004 >> v2:172.21.15.150:3300/0 conn(0x7f3118062380 0x7f31180ba0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:05.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.429+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054394261 0 0) 0x7f31180bd2c0 con 0x7f311814d470 2020-11-20T12:14:05.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.429+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30fc003240 con 0x7f311814d470 2020-11-20T12:14:05.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.429+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305439025 0 0) 0x7f31180bd020 con 0x7f31181507c0 2020-11-20T12:14:05.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.429+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31180bd2c0 con 0x7f31181507c0 2020-11-20T12:14:05.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f310effd700 1 -- 172.21.15.160:0/1412350004 >> v1:172.21.15.150:6789/0 conn(0x7f311814d470 legacy=0x7f311814d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:05.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2693557681 0 0) 0x7f30fc003240 con 0x7f311814d470 2020-11-20T12:14:05.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f310effd700 1 -- 172.21.15.160:0/1412350004 >> v1:172.21.15.134:6789/0 conn(0x7f31181507c0 legacy=0x7f3118150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:05.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f310effd700 1 -- 172.21.15.160:0/1412350004 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180bbd20 con 0x7f3118062380 2020-11-20T12:14:05.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f310effd700 1 --2- 172.21.15.160:0/1412350004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 0x7f31180ba0b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f310000cab0 tx=0x7f3100006e80).ready entity=mon.1 client_cookie=b2f4d98f062065a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:05.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100014070 con 0x7f3118062380 2020-11-20T12:14:05.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000a630 con 0x7f3118062380 2020-11-20T12:14:05.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.430+0000 7f3116ffd700 1 -- 172.21.15.160:0/1412350004 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31100018a0 con 0x7f3118062380 2020-11-20T12:14:05.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.431+0000 7f311ccb9700 1 -- 172.21.15.160:0/1412350004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 msgr2=0x7f31180ba0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:05.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.431+0000 7f311ccb9700 1 --2- 172.21.15.160:0/1412350004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 0x7f31180ba0b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f310000cab0 tx=0x7f3100006e80).stop 2020-11-20T12:14:05.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.431+0000 7f311ccb9700 1 -- 172.21.15.160:0/1412350004 shutdown_connections 2020-11-20T12:14:05.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.431+0000 7f311ccb9700 1 --2- 172.21.15.160:0/1412350004 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 0x7f31180ba0b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:05.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.431+0000 7f311ccb9700 1 -- 172.21.15.160:0/1412350004 >> 172.21.15.160:0/1412350004 conn(0x7f31180c2f70 msgr2=0x7f31180c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:05.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.431+0000 7f311ccb9700 1 -- 172.21.15.160:0/1412350004 shutdown_connections 2020-11-20T12:14:05.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.431+0000 7f311ccb9700 1 -- 172.21.15.160:0/1412350004 wait complete. 2020-11-20T12:14:05.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.433+0000 7f311ccb9700 1 Processor -- start 2020-11-20T12:14:05.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.433+0000 7f311ccb9700 1 -- start start 2020-11-20T12:14:05.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f311ccb9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 0x7f311814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:05.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f311ccb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f311814d470 0x7f311814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:05.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f311ccb9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31181507c0 0x7f3118146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:05.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f311ccb9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118148680 con 0x7f311814d470 2020-11-20T12:14:05.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f311ccb9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3118150070 con 0x7f3118062380 2020-11-20T12:14:05.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f311ccb9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31181638d0 con 0x7f31181507c0 2020-11-20T12:14:05.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f310effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f311814d470 0x7f311814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:05.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f3117fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31181507c0 0x7f3118146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:05.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f31177fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 0x7f311814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:05.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f310effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f311814d470 0x7f311814fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60084/0 (socket says 172.21.15.160:60084) 2020-11-20T12:14:05.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f3117fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31181507c0 0x7f3118146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37564/0 (socket says 172.21.15.160:37564) 2020-11-20T12:14:05.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.434+0000 7f310effd700 1 -- 172.21.15.160:0/2247448714 learned_addr learned my addr 172.21.15.160:0/2247448714 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:05.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f3117fff700 1 -- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 msgr2=0x7f311814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:05.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f3117fff700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 0x7f311814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:05.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f3117fff700 1 -- 172.21.15.160:0/2247448714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f311814d470 msgr2=0x7f311814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:05.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f3117fff700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f311814d470 0x7f311814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:05.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f3117fff700 1 -- 172.21.15.160:0/2247448714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118163b70 con 0x7f31181507c0 2020-11-20T12:14:05.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f3117fff700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31181507c0 0x7f3118146250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3110007d60 tx=0x7f3110001800).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:05.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f310ffff700 1 -- 172.21.15.160:0/2247448714 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000f070 con 0x7f31181507c0 2020-11-20T12:14:05.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f310ffff700 1 -- 172.21.15.160:0/2247448714 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3110007e50 con 0x7f31181507c0 2020-11-20T12:14:05.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f310ffff700 1 -- 172.21.15.160:0/2247448714 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311000a320 con 0x7f31181507c0 2020-11-20T12:14:05.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3118163e10 con 0x7f31181507c0 2020-11-20T12:14:05.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.435+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3118146740 con 0x7f31181507c0 2020-11-20T12:14:05.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.436+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31180bb770 con 0x7f31181507c0 2020-11-20T12:14:05.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.437+0000 7f310ffff700 1 -- 172.21.15.160:0/2247448714 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3110001d70 con 0x7f31181507c0 2020-11-20T12:14:05.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.438+0000 7f310ffff700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f30e8080630 0x7f30e8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:05.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.439+0000 7f310ffff700 1 -- 172.21.15.160:0/2247448714 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f31100a23e0 con 0x7f31181507c0 2020-11-20T12:14:05.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.439+0000 7f31177fe700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f30e8080630 0x7f30e8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:05.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.439+0000 7f31177fe700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f30e8080630 0x7f30e8082af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3108007fd0 tx=0x7f3108009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:05.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.442+0000 7f310ffff700 1 -- 172.21.15.160:0/2247448714 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3110077210 con 0x7f31181507c0 2020-11-20T12:14:05.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:05.629+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3118069460 con 0x7f31181507c0 2020-11-20T12:14:06.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.163+0000 7f310ffff700 1 -- 172.21.15.160:0/2247448714 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f311007a830 con 0x7f31181507c0 2020-11-20T12:14:06.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f30e8080630 msgr2=0x7f30e8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f30e8080630 0x7f30e8082af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3108007fd0 tx=0x7f3108009040).stop 2020-11-20T12:14:06.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31181507c0 msgr2=0x7f3118146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31181507c0 0x7f3118146250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3110007d60 tx=0x7f3110001800).stop 2020-11-20T12:14:06.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 shutdown_connections 2020-11-20T12:14:06.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f30e8080630 0x7f30e8082af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31181507c0 0x7f3118146250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3118062380 0x7f311814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 --2- 172.21.15.160:0/2247448714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f311814d470 0x7f311814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.167+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 >> 172.21.15.160:0/2247448714 conn(0x7f31180c2f70 msgr2=0x7f3118150cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:06.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.168+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 shutdown_connections 2020-11-20T12:14:06.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.168+0000 7f311ccb9700 1 -- 172.21.15.160:0/2247448714 wait complete. 2020-11-20T12:14:06.178 INFO:teuthology.orchestra.run.smithi160.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T12:14:06.195 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T12:14:06.195 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T12:14:06.196 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T12:14:06.206 INFO:tasks.ceph.mds.a:Started 2020-11-20T12:14:06.206 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T12:14:06.206 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T12:14:06.209 INFO:tasks.ceph.mds.b:Started 2020-11-20T12:14:06.210 INFO:tasks.ceph.mds.c:Restarting daemon 2020-11-20T12:14:06.210 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-11-20T12:14:06.213 INFO:tasks.ceph.mds.c:Started 2020-11-20T12:14:06.214 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T12:14:06.215 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:06.293 INFO:tasks.ceph.mds.b.smithi150.stdout:starting mds.b at 2020-11-20T12:14:06.296 INFO:tasks.ceph.mds.c.smithi134.stdout:starting mds.c at 2020-11-20T12:14:06.364 INFO:tasks.ceph.mds.a.smithi160.stdout:starting mds.a at 2020-11-20T12:14:06.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.431+0000 7f9182006700 1 Processor -- start 2020-11-20T12:14:06.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.431+0000 7f9182006700 1 -- start start 2020-11-20T12:14:06.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f9182006700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f917c0bdfc0 0x7f917c061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f9182006700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c064e00 con 0x7f917c063a10 2020-11-20T12:14:06.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f9182006700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c0bca40 con 0x7f917c061870 2020-11-20T12:14:06.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f9182006700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c0bf640 con 0x7f917c0bdfc0 2020-11-20T12:14:06.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f9181004700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f917c061870 0x7f917c0bd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55160/0 (socket says 172.21.15.160:55160) 2020-11-20T12:14:06.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f9181004700 1 -- 172.21.15.160:0/743346858 learned_addr learned my addr 172.21.15.160:0/743346858 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:06.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f9180803700 1 --2- 172.21.15.160:0/743346858 >> v2:172.21.15.150:3300/0 conn(0x7f917c0bdfc0 0x7f917c061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153543197 0 0) 0x7f917c064e00 con 0x7f917c063a10 2020-11-20T12:14:06.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9164003240 con 0x7f917c063a10 2020-11-20T12:14:06.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874968692 0 0) 0x7f917c0bca40 con 0x7f917c061870 2020-11-20T12:14:06.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.433+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f917c064e00 con 0x7f917c061870 2020-11-20T12:14:06.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2561223346 0 0) 0x7f9164003240 con 0x7f917c063a10 2020-11-20T12:14:06.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 >> v2:172.21.15.150:3300/0 conn(0x7f917c0bdfc0 msgr2=0x7f917c061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:06.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 --2- 172.21.15.160:0/743346858 >> v2:172.21.15.150:3300/0 conn(0x7f917c0bdfc0 0x7f917c061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 >> v1:172.21.15.160:6789/0 conn(0x7f917c061870 legacy=0x7f917c0bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.460 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0bcce0 con 0x7f917c063a10 2020-11-20T12:14:06.460 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f9174001860 con 0x7f917c063a10 2020-11-20T12:14:06.461 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 >> v1:172.21.15.134:6789/0 conn(0x7f917c063a10 legacy=0x7f917c14f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.461 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f9164003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91640044e0 0x7f9164004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9164004ea0 0x7f916400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916400bc20 con 0x7f91640039b0 2020-11-20T12:14:06.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916400bd60 con 0x7f9164004ea0 2020-11-20T12:14:06.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916400bed0 con 0x7f91640044e0 2020-11-20T12:14:06.464 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f9181004700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f9164003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.464 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f9180803700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91640044e0 0x7f9164004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.434+0000 7f9181805700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9164004ea0 0x7f916400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f9181004700 1 -- 172.21.15.160:0/743346858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91640044e0 msgr2=0x7f9164004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:06.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f9181004700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91640044e0 0x7f9164004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f9181004700 1 -- 172.21.15.160:0/743346858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9164004ea0 msgr2=0x7f916400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:06.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f9181004700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9164004ea0 0x7f916400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f9181805700 1 -- 172.21.15.160:0/743346858 reap_dead start 2020-11-20T12:14:06.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f9181004700 1 -- 172.21.15.160:0/743346858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164003240 con 0x7f91640039b0 2020-11-20T12:14:06.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f9181004700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f9164003db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9178001980 tx=0x7f9178007c80).ready entity=mon.0 client_cookie=bde023b915151014 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:06.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91780072e0 con 0x7f91640039b0 2020-11-20T12:14:06.470 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178007440 con 0x7f91640039b0 2020-11-20T12:14:06.470 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.435+0000 7f916bfff700 1 -- 172.21.15.160:0/743346858 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917800c850 con 0x7f91640039b0 2020-11-20T12:14:06.470 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.436+0000 7f9182006700 1 -- 172.21.15.160:0/743346858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 msgr2=0x7f9164003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.436+0000 7f9182006700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f9164003db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9178001980 tx=0x7f9178007c80).stop 2020-11-20T12:14:06.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.436+0000 7f9182006700 1 -- 172.21.15.160:0/743346858 shutdown_connections 2020-11-20T12:14:06.472 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.436+0000 7f9182006700 1 --2- 172.21.15.160:0/743346858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f9164003db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.474 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.436+0000 7f9182006700 1 -- 172.21.15.160:0/743346858 >> 172.21.15.160:0/743346858 conn(0x7f917c062ef0 msgr2=0x7f917c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:06.474 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.436+0000 7f9182006700 1 -- 172.21.15.160:0/743346858 shutdown_connections 2020-11-20T12:14:06.475 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.436+0000 7f9182006700 1 -- 172.21.15.160:0/743346858 wait complete. 2020-11-20T12:14:06.475 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.438+0000 7f9182006700 1 Processor -- start 2020-11-20T12:14:06.476 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.438+0000 7f9182006700 1 -- start start 2020-11-20T12:14:06.477 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9182006700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f917c113d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.477 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9182006700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f917c162150 0x7f917c110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.478 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9182006700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f917c1617e0 0x7f917c10e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.478 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9182006700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c110d10 con 0x7f91640039b0 2020-11-20T12:14:06.479 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9182006700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c114240 con 0x7f917c1617e0 2020-11-20T12:14:06.479 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9182006700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c114480 con 0x7f917c162150 2020-11-20T12:14:06.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9180803700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f917c162150 0x7f917c110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9180803700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f917c162150 0x7f917c110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37594/0 (socket says 172.21.15.160:37594) 2020-11-20T12:14:06.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9180803700 1 -- 172.21.15.160:0/1391577284 learned_addr learned my addr 172.21.15.160:0/1391577284 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:06.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9181004700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f917c113d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.439+0000 7f9181805700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f917c1617e0 0x7f917c10e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.483 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9180803700 1 -- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f917c1617e0 msgr2=0x7f917c10e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.483 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9180803700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f917c1617e0 0x7f917c10e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.485 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9180803700 1 -- 172.21.15.160:0/1391577284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 msgr2=0x7f917c113d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.485 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9180803700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f917c113d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.486 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9180803700 1 -- 172.21.15.160:0/1391577284 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c10d810 con 0x7f917c162150 2020-11-20T12:14:06.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9180803700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f917c162150 0x7f917c110080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f916c011a10 tx=0x7f916c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:06.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f91697fa700 1 -- 172.21.15.160:0/1391577284 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00f850 con 0x7f917c162150 2020-11-20T12:14:06.488 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f91697fa700 1 -- 172.21.15.160:0/1391577284 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00f9b0 con 0x7f917c162150 2020-11-20T12:14:06.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c10dab0 con 0x7f917c162150 2020-11-20T12:14:06.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f91697fa700 1 -- 172.21.15.160:0/1391577284 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00fd30 con 0x7f917c162150 2020-11-20T12:14:06.490 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.440+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c10dff0 con 0x7f917c162150 2020-11-20T12:14:06.490 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.441+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c10e1b0 con 0x7f917c162150 2020-11-20T12:14:06.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.442+0000 7f91697fa700 1 -- 172.21.15.160:0/1391577284 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f916c014650 con 0x7f917c162150 2020-11-20T12:14:06.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.443+0000 7f91697fa700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9154080630 0x7f9154082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.444+0000 7f91697fa700 1 -- 172.21.15.160:0/1391577284 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f916c0a2e00 con 0x7f917c162150 2020-11-20T12:14:06.495 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.444+0000 7f9181004700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9154080630 0x7f9154082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.496 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.444+0000 7f9181004700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9154080630 0x7f9154082af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9178008fd0 tx=0x7f9178015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:06.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.447+0000 7f91697fa700 1 -- 172.21.15.160:0/1391577284 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f916c077d30 con 0x7f917c162150 2020-11-20T12:14:06.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.633+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f917c110570 con 0x7f917c162150 2020-11-20T12:14:06.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.634+0000 7f91697fa700 1 -- 172.21.15.160:0/1391577284 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18439 (secure 0 0 0) 0x7f916c018070 con 0x7f917c162150 2020-11-20T12:14:06.638 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:06.639 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":21,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:06.150946+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:06.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.636+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9154080630 msgr2=0x7f9154082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.636+0000 7f9182006700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9154080630 0x7f9154082af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f9178008fd0 tx=0x7f9178015000).stop 2020-11-20T12:14:06.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.636+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f917c162150 msgr2=0x7f917c110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.636+0000 7f9182006700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f917c162150 0x7f917c110080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f916c011a10 tx=0x7f916c006df0).stop 2020-11-20T12:14:06.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 shutdown_connections 2020-11-20T12:14:06.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9154080630 0x7f9154082af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f917c1617e0 0x7f917c10e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91640039b0 0x7f917c113d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 --2- 172.21.15.160:0/1391577284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f917c162150 0x7f917c110080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 >> 172.21.15.160:0/1391577284 conn(0x7f917c062ef0 msgr2=0x7f917c148da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:06.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 shutdown_connections 2020-11-20T12:14:06.643 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.637+0000 7f9182006700 1 -- 172.21.15.160:0/1391577284 wait complete. 2020-11-20T12:14:06.663 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:13:54.112655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:04.811782+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T12:14:06.664 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:06.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.905+0000 7fcfc5077700 1 Processor -- start 2020-11-20T12:14:06.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.906+0000 7fcfc5077700 1 -- start start 2020-11-20T12:14:06.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.907+0000 7fcfc5077700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcfc00bb650 0x7fcfc0061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.907+0000 7fcfc5077700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fcfc00bcf40 0x7fcfc014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.907+0000 7fcfc5077700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00bbae0 con 0x7fcfc0061870 2020-11-20T12:14:06.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.907+0000 7fcfc5077700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00bbd80 con 0x7fcfc00bcf40 2020-11-20T12:14:06.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.907+0000 7fcfc5077700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00bc560 con 0x7fcfc00bb650 2020-11-20T12:14:06.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfb77fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcfc00bb650 0x7fcfc0061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfbffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fcfc0061870 0x7fcfc0064fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46444/0 (socket says 172.21.15.160:46444) 2020-11-20T12:14:06.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfbffff700 1 -- 172.21.15.160:0/2348892571 learned_addr learned my addr 172.21.15.160:0/2348892571 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:06.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfc4876700 1 --2- 172.21.15.160:0/2348892571 >> v2:172.21.15.134:3300/0 conn(0x7fcfc00bcf40 0x7fcfc014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfbf7fe700 1 -- 172.21.15.160:0/2348892571 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347086584 0 0) 0x7fcfc00bbae0 con 0x7fcfc0061870 2020-11-20T12:14:06.916 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfbf7fe700 1 -- 172.21.15.160:0/2348892571 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa0003240 con 0x7fcfc0061870 2020-11-20T12:14:06.916 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfb77fe700 1 -- 172.21.15.160:0/2348892571 >> v2:172.21.15.134:3300/0 conn(0x7fcfc00bcf40 msgr2=0x7fcfc014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:06.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfb77fe700 1 --2- 172.21.15.160:0/2348892571 >> v2:172.21.15.134:3300/0 conn(0x7fcfc00bcf40 0x7fcfc014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfb77fe700 1 -- 172.21.15.160:0/2348892571 >> v1:172.21.15.150:6789/0 conn(0x7fcfc0061870 legacy=0x7fcfc0064fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.908+0000 7fcfb77fe700 1 -- 172.21.15.160:0/2348892571 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc00bc800 con 0x7fcfc00bb650 2020-11-20T12:14:06.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.909+0000 7fcfb77fe700 1 --2- 172.21.15.160:0/2348892571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bb650 0x7fcfc0061c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcfc0067750 tx=0x7fcfa8006df0).ready entity=mon.2 client_cookie=5054457657e910c0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:06.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.909+0000 7fcfbf7fe700 1 -- 172.21.15.160:0/2348892571 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80096d0 con 0x7fcfc00bb650 2020-11-20T12:14:06.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.909+0000 7fcfbf7fe700 1 -- 172.21.15.160:0/2348892571 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8009830 con 0x7fcfc00bb650 2020-11-20T12:14:06.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.909+0000 7fcfbf7fe700 1 -- 172.21.15.160:0/2348892571 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8009bb0 con 0x7fcfc00bb650 2020-11-20T12:14:06.922 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.909+0000 7fcfc5077700 1 -- 172.21.15.160:0/2348892571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bb650 msgr2=0x7fcfc0061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.922 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.909+0000 7fcfc5077700 1 --2- 172.21.15.160:0/2348892571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bb650 0x7fcfc0061c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcfc0067750 tx=0x7fcfa8006df0).stop 2020-11-20T12:14:06.922 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.910+0000 7fcfc5077700 1 -- 172.21.15.160:0/2348892571 shutdown_connections 2020-11-20T12:14:06.923 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.910+0000 7fcfc5077700 1 --2- 172.21.15.160:0/2348892571 >> v2:172.21.15.134:3300/0 conn(0x7fcfc00bcf40 0x7fcfc014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.923 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.910+0000 7fcfc5077700 1 --2- 172.21.15.160:0/2348892571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bb650 0x7fcfc0061c50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.923 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.910+0000 7fcfc5077700 1 -- 172.21.15.160:0/2348892571 >> 172.21.15.160:0/2348892571 conn(0x7fcfc0060140 msgr2=0x7fcfc0060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:06.923 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.910+0000 7fcfc5077700 1 -- 172.21.15.160:0/2348892571 shutdown_connections 2020-11-20T12:14:06.924 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.910+0000 7fcfc5077700 1 -- 172.21.15.160:0/2348892571 wait complete. 2020-11-20T12:14:06.924 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.912+0000 7fcfc5077700 1 Processor -- start 2020-11-20T12:14:06.924 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.912+0000 7fcfc5077700 1 -- start start 2020-11-20T12:14:06.924 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfc5077700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc0061870 0x7fcfc0160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfc5077700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bcf40 0x7fcfc01442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfc5077700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc01447b0 0x7fcfc0146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfc5077700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0160c30 con 0x7fcfc01447b0 2020-11-20T12:14:06.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfc5077700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0150870 con 0x7fcfc0061870 2020-11-20T12:14:06.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfc5077700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0150b10 con 0x7fcfc00bcf40 2020-11-20T12:14:06.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bcf40 0x7fcfc01442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfb77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bcf40 0x7fcfc01442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37608/0 (socket says 172.21.15.160:37608) 2020-11-20T12:14:06.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfbffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc0061870 0x7fcfc0160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfb77fe700 1 -- 172.21.15.160:0/3008118477 learned_addr learned my addr 172.21.15.160:0/3008118477 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:06.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.913+0000 7fcfc4876700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc01447b0 0x7fcfc0146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfb77fe700 1 -- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc0061870 msgr2=0x7fcfc0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfb77fe700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc0061870 0x7fcfc0160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfb77fe700 1 -- 172.21.15.160:0/3008118477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc01447b0 msgr2=0x7fcfc0146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:06.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfb77fe700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc01447b0 0x7fcfc0146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:06.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfb77fe700 1 -- 172.21.15.160:0/3008118477 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0150db0 con 0x7fcfc00bcf40 2020-11-20T12:14:06.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfb77fe700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bcf40 0x7fcfc01442c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcfa8006fd0 tx=0x7fcfa8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:06.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfbcff9700 1 -- 172.21.15.160:0/3008118477 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa801e460 con 0x7fcfc00bcf40 2020-11-20T12:14:06.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfbcff9700 1 -- 172.21.15.160:0/3008118477 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa801e5c0 con 0x7fcfc00bcf40 2020-11-20T12:14:06.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc0151050 con 0x7fcfc00bcf40 2020-11-20T12:14:06.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfbcff9700 1 -- 172.21.15.160:0/3008118477 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa801e940 con 0x7fcfc00bcf40 2020-11-20T12:14:06.929 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.914+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc0151590 con 0x7fcfc00bcf40 2020-11-20T12:14:06.929 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.916+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc0044f60 con 0x7fcfc00bcf40 2020-11-20T12:14:06.929 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.916+0000 7fcfbcff9700 1 -- 172.21.15.160:0/3008118477 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcfa8025030 con 0x7fcfc00bcf40 2020-11-20T12:14:06.930 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.918+0000 7fcfbcff9700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcf9c080630 0x7fcf9c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:06.930 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.918+0000 7fcfbcff9700 1 -- 172.21.15.160:0/3008118477 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fcfa80a3dc0 con 0x7fcfc00bcf40 2020-11-20T12:14:06.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.918+0000 7fcfbffff700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcf9c080630 0x7fcf9c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:06.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.919+0000 7fcfbffff700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcf9c080630 0x7fcf9c082af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcfb0006a30 tx=0x7fcfb0009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:06.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:06.921+0000 7fcfbcff9700 1 -- 172.21.15.160:0/3008118477 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fcfa8078cf0 con 0x7fcfc00bcf40 2020-11-20T12:14:07.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.107+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcfc0060d70 con 0x7fcfc00bcf40 2020-11-20T12:14:07.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.108+0000 7fcfbcff9700 1 -- 172.21.15.160:0/3008118477 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcfa8023020 con 0x7fcfc00bcf40 2020-11-20T12:14:07.111 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 1 2020-11-20T12:14:07.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcf9c080630 msgr2=0x7fcf9c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcf9c080630 0x7fcf9c082af0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fcfb0006a30 tx=0x7fcfb0009040).stop 2020-11-20T12:14:07.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bcf40 msgr2=0x7fcfc01442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bcf40 0x7fcfc01442c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fcfa8006fd0 tx=0x7fcfa8015000).stop 2020-11-20T12:14:07.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 shutdown_connections 2020-11-20T12:14:07.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcf9c080630 0x7fcf9c082af0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcfc01447b0 0x7fcfc0146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfc0061870 0x7fcfc0160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 --2- 172.21.15.160:0/3008118477 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfc00bcf40 0x7fcfc01442c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 >> 172.21.15.160:0/3008118477 conn(0x7fcfc0060140 msgr2=0x7fcfc013bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:07.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 shutdown_connections 2020-11-20T12:14:07.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.110+0000 7fcfc5077700 1 -- 172.21.15.160:0/3008118477 wait complete. 2020-11-20T12:14:07.138 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:07.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.384+0000 7fd4d359e700 1 Processor -- start 2020-11-20T12:14:07.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.384+0000 7fd4d359e700 1 -- start start 2020-11-20T12:14:07.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.385+0000 7fd4d359e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd4d414c440 0x7fd4d4064490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.385+0000 7fd4d359e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd4d40bd890 0x7fd4d414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.385+0000 7fd4d359e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d414f0f0 con 0x7fd4d40640b0 2020-11-20T12:14:07.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.385+0000 7fd4d359e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d414f390 con 0x7fd4d40bd890 2020-11-20T12:14:07.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.386+0000 7fd4d359e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d414f630 con 0x7fd4d414c440 2020-11-20T12:14:07.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.386+0000 7fd4d1d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd4d414c440 0x7fd4d4064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.386+0000 7fd4d259c700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fd4d40640b0 0x7fd4d414bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:59924/0 (socket says 172.21.15.160:59924) 2020-11-20T12:14:07.391 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.386+0000 7fd4d259c700 1 -- 172.21.15.160:0/1474763785 learned_addr learned my addr 172.21.15.160:0/1474763785 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:07.391 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.386+0000 7fd4d2d9d700 1 --2- 172.21.15.160:0/1474763785 >> v2:172.21.15.150:3300/0 conn(0x7fd4d40bd890 0x7fd4d414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.386+0000 7fd4d159a700 1 -- 172.21.15.160:0/1474763785 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538597903 0 0) 0x7fd4d414f0f0 con 0x7fd4d40640b0 2020-11-20T12:14:07.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.386+0000 7fd4d159a700 1 -- 172.21.15.160:0/1474763785 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4b8003240 con 0x7fd4d40640b0 2020-11-20T12:14:07.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d2d9d700 1 -- 172.21.15.160:0/1474763785 >> v2:172.21.15.160:3300/0 conn(0x7fd4d414c440 msgr2=0x7fd4d4064490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:07.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d2d9d700 1 --2- 172.21.15.160:0/1474763785 >> v2:172.21.15.160:3300/0 conn(0x7fd4d414c440 0x7fd4d4064490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d2d9d700 1 -- 172.21.15.160:0/1474763785 >> v1:172.21.15.134:6789/0 conn(0x7fd4d40640b0 legacy=0x7fd4d414bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d2d9d700 1 -- 172.21.15.160:0/1474763785 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d414f8d0 con 0x7fd4d40bd890 2020-11-20T12:14:07.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d2d9d700 1 --2- 172.21.15.160:0/1474763785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40bd890 0x7fd4d414eaa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd4d40628c0 tx=0x7fd4cc0091d0).ready entity=mon.1 client_cookie=9663ad5dfa899cfa server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:07.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d159a700 1 -- 172.21.15.160:0/1474763785 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00ba20 con 0x7fd4d40bd890 2020-11-20T12:14:07.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d159a700 1 -- 172.21.15.160:0/1474763785 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00bb80 con 0x7fd4d40bd890 2020-11-20T12:14:07.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.387+0000 7fd4d159a700 1 -- 172.21.15.160:0/1474763785 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc011400 con 0x7fd4d40bd890 2020-11-20T12:14:07.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 -- 172.21.15.160:0/1474763785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40bd890 msgr2=0x7fd4d414eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 --2- 172.21.15.160:0/1474763785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40bd890 0x7fd4d414eaa0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd4d40628c0 tx=0x7fd4cc0091d0).stop 2020-11-20T12:14:07.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 -- 172.21.15.160:0/1474763785 shutdown_connections 2020-11-20T12:14:07.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 --2- 172.21.15.160:0/1474763785 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40bd890 0x7fd4d414eaa0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 --2- 172.21.15.160:0/1474763785 >> v2:172.21.15.160:3300/0 conn(0x7fd4d414c440 0x7fd4d4064490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 -- 172.21.15.160:0/1474763785 >> 172.21.15.160:0/1474763785 conn(0x7fd4d4060140 msgr2=0x7fd4d4060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:07.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 -- 172.21.15.160:0/1474763785 shutdown_connections 2020-11-20T12:14:07.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.388+0000 7fd4d359e700 1 -- 172.21.15.160:0/1474763785 wait complete. 2020-11-20T12:14:07.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.389+0000 7fd4d359e700 1 Processor -- start 2020-11-20T12:14:07.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.390+0000 7fd4d359e700 1 -- start start 2020-11-20T12:14:07.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40640b0 0x7fd4d40b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d359e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d40bd890 0x7fd4d410fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4d414c440 0x7fd4d4155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d359e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4155750 con 0x7fd4d40bd890 2020-11-20T12:14:07.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4110460 con 0x7fd4d40640b0 2020-11-20T12:14:07.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d359e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d4163410 con 0x7fd4d414c440 2020-11-20T12:14:07.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d2d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4d414c440 0x7fd4d4155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d1d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d40bd890 0x7fd4d410fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d1d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d40bd890 0x7fd4d410fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60146/0 (socket says 172.21.15.160:60146) 2020-11-20T12:14:07.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d1d9b700 1 -- 172.21.15.160:0/270677036 learned_addr learned my addr 172.21.15.160:0/270677036 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:07.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d259c700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40640b0 0x7fd4d40b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d2d9d700 1 -- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40640b0 msgr2=0x7fd4d40b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d2d9d700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40640b0 0x7fd4d40b9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d2d9d700 1 -- 172.21.15.160:0/270677036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d40bd890 msgr2=0x7fd4d410fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d2d9d700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d40bd890 0x7fd4d410fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d2d9d700 1 -- 172.21.15.160:0/270677036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d41636b0 con 0x7fd4d414c440 2020-11-20T12:14:07.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.391+0000 7fd4d1d9b700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d40bd890 0x7fd4d410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:07.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.392+0000 7fd4d2d9d700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4d414c440 0x7fd4d4155260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd4cc013000 tx=0x7fd4cc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:07.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.392+0000 7fd4c27fc700 1 -- 172.21.15.160:0/270677036 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc01c5f0 con 0x7fd4d414c440 2020-11-20T12:14:07.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.392+0000 7fd4c27fc700 1 -- 172.21.15.160:0/270677036 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc01c750 con 0x7fd4d414c440 2020-11-20T12:14:07.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.392+0000 7fd4c27fc700 1 -- 172.21.15.160:0/270677036 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc01cad0 con 0x7fd4d414c440 2020-11-20T12:14:07.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.392+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d4163950 con 0x7fd4d414c440 2020-11-20T12:14:07.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.392+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d4164090 con 0x7fd4d414c440 2020-11-20T12:14:07.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.393+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d4044f60 con 0x7fd4d414c440 2020-11-20T12:14:07.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.394+0000 7fd4c27fc700 1 -- 172.21.15.160:0/270677036 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd4cc024030 con 0x7fd4d414c440 2020-11-20T12:14:07.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.395+0000 7fd4c27fc700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd4a8080660 0x7fd4a8082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.396+0000 7fd4c27fc700 1 -- 172.21.15.160:0/270677036 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fd4cc0a4000 con 0x7fd4d414c440 2020-11-20T12:14:07.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.396+0000 7fd4d259c700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd4a8080660 0x7fd4a8082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.397+0000 7fd4d259c700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd4a8080660 0x7fd4a8082b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd4c40055a0 tx=0x7fd4c4009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:07.405 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.399+0000 7fd4c27fc700 1 -- 172.21.15.160:0/270677036 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd4cc04efd0 con 0x7fd4d414c440 2020-11-20T12:14:07.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.587+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd4d4060dc0 con 0x7fd4d414c440 2020-11-20T12:14:07.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.588+0000 7fd4c27fc700 1 -- 172.21.15.160:0/270677036 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd4cc022070 con 0x7fd4d414c440 2020-11-20T12:14:07.593 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:07.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd4a8080660 msgr2=0x7fd4a8082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd4a8080660 0x7fd4a8082b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd4c40055a0 tx=0x7fd4c4009040).stop 2020-11-20T12:14:07.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4d414c440 msgr2=0x7fd4d4155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4d414c440 0x7fd4d4155260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd4cc013000 tx=0x7fd4cc016000).stop 2020-11-20T12:14:07.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 shutdown_connections 2020-11-20T12:14:07.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd4a8080660 0x7fd4a8082b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4d414c440 0x7fd4d4155260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd4d40640b0 0x7fd4d40b9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 --2- 172.21.15.160:0/270677036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d40bd890 0x7fd4d410fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.590+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 >> 172.21.15.160:0/270677036 conn(0x7fd4d4060140 msgr2=0x7fd4d4148d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:07.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.591+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 shutdown_connections 2020-11-20T12:14:07.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.591+0000 7fd4d359e700 1 -- 172.21.15.160:0/270677036 wait complete. 2020-11-20T12:14:07.618 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-11-20T12:14:07.862 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.858+0000 7f900a32b700 1 Processor -- start 2020-11-20T12:14:07.862 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.859+0000 7f900a32b700 1 -- start start 2020-11-20T12:14:07.863 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.860+0000 7f900a32b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9004061870 0x7f9004061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.864 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.860+0000 7f900a32b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90040c0510 0x7f90040bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.864 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.860+0000 7f900a32b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9004150ed0 con 0x7f90040bb790 2020-11-20T12:14:07.864 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.860+0000 7f900a32b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9004151170 con 0x7f90040c0510 2020-11-20T12:14:07.864 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.860+0000 7f900a32b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9004151410 con 0x7f9004061870 2020-11-20T12:14:07.865 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9009329700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9004061870 0x7f9004061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.865 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9008b28700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90040c0510 0x7f90040bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.865 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9008b28700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f90040c0510 0x7f90040bb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:50768/0 (socket says 172.21.15.160:50768) 2020-11-20T12:14:07.866 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9008b28700 1 -- 172.21.15.160:0/789904720 learned_addr learned my addr 172.21.15.160:0/789904720 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:07.866 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f8ff3fff700 1 -- 172.21.15.160:0/789904720 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565836999 0 0) 0x7f9004150ed0 con 0x7f90040bb790 2020-11-20T12:14:07.866 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f8ff3fff700 1 -- 172.21.15.160:0/789904720 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fec003240 con 0x7f90040bb790 2020-11-20T12:14:07.866 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9008b28700 1 -- 172.21.15.160:0/789904720 >> v2:172.21.15.160:3300/0 conn(0x7f9004061870 msgr2=0x7f9004061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:07.868 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9008b28700 1 --2- 172.21.15.160:0/789904720 >> v2:172.21.15.160:3300/0 conn(0x7f9004061870 0x7f9004061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.868 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9008b28700 1 -- 172.21.15.160:0/789904720 >> v1:172.21.15.134:6789/0 conn(0x7f90040bb790 legacy=0x7f9004064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.868 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.861+0000 7f9008b28700 1 -- 172.21.15.160:0/789904720 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90041516b0 con 0x7f90040c0510 2020-11-20T12:14:07.868 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f9008b28700 1 --2- 172.21.15.160:0/789904720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040c0510 0x7f90040bb2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f900405c2a0 tx=0x7f8ff4006eb0).ready entity=mon.1 client_cookie=5f441bdce3f38d33 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:07.868 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f8ff3fff700 1 -- 172.21.15.160:0/789904720 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40097b0 con 0x7f90040c0510 2020-11-20T12:14:07.869 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f8ff3fff700 1 -- 172.21.15.160:0/789904720 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff4009910 con 0x7f90040c0510 2020-11-20T12:14:07.869 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f8ff3fff700 1 -- 172.21.15.160:0/789904720 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4009c90 con 0x7f90040c0510 2020-11-20T12:14:07.869 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f900a32b700 1 -- 172.21.15.160:0/789904720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040c0510 msgr2=0x7f90040bb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.869 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f900a32b700 1 --2- 172.21.15.160:0/789904720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040c0510 0x7f90040bb2a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f900405c2a0 tx=0x7f8ff4006eb0).stop 2020-11-20T12:14:07.869 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f900a32b700 1 -- 172.21.15.160:0/789904720 shutdown_connections 2020-11-20T12:14:07.870 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f900a32b700 1 --2- 172.21.15.160:0/789904720 >> v2:172.21.15.160:3300/0 conn(0x7f9004061870 0x7f9004061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.870 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f900a32b700 1 --2- 172.21.15.160:0/789904720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f90040c0510 0x7f90040bb2a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.870 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.862+0000 7f900a32b700 1 -- 172.21.15.160:0/789904720 >> 172.21.15.160:0/789904720 conn(0x7f9004062ef0 msgr2=0x7f9004063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:07.870 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.863+0000 7f900a32b700 1 -- 172.21.15.160:0/789904720 shutdown_connections 2020-11-20T12:14:07.870 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.863+0000 7f900a32b700 1 -- 172.21.15.160:0/789904720 wait complete. 2020-11-20T12:14:07.871 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.864+0000 7f900a32b700 1 Processor -- start 2020-11-20T12:14:07.871 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.865+0000 7f900a32b700 1 -- start start 2020-11-20T12:14:07.873 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f900a32b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9004061870 0x7f9004160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.873 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f900a32b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90040bb790 0x7f9004063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.873 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f900a32b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c0510 0x7f900414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.873 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f900a32b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004160fb0 con 0x7f90040c0510 2020-11-20T12:14:07.873 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f900a32b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004161510 con 0x7f9004061870 2020-11-20T12:14:07.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f900a32b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004111f00 con 0x7f90040bb790 2020-11-20T12:14:07.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90040bb790 0x7f9004063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90040bb790 0x7f9004063490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37636/0 (socket says 172.21.15.160:37636) 2020-11-20T12:14:07.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 -- 172.21.15.160:0/1890865788 learned_addr learned my addr 172.21.15.160:0/1890865788 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:07.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9009b2a700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c0510 0x7f900414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9009329700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9004061870 0x7f9004160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 -- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9004061870 msgr2=0x7f9004160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9004061870 0x7f9004160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 -- 172.21.15.160:0/1890865788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c0510 msgr2=0x7f900414bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:07.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c0510 0x7f900414bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:07.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.866+0000 7f9008b28700 1 -- 172.21.15.160:0/1890865788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004112160 con 0x7f90040bb790 2020-11-20T12:14:07.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.867+0000 7f9009b2a700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c0510 0x7f900414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:07.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.867+0000 7f9008b28700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90040bb790 0x7f9004063490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8ff4006ef0 tx=0x7f8ff4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:07.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.867+0000 7f8ff17fa700 1 -- 172.21.15.160:0/1890865788 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4011c80 con 0x7f90040bb790 2020-11-20T12:14:07.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.867+0000 7f8ff17fa700 1 -- 172.21.15.160:0/1890865788 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff4011de0 con 0x7f90040bb790 2020-11-20T12:14:07.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.867+0000 7f8ff17fa700 1 -- 172.21.15.160:0/1890865788 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff401e690 con 0x7f90040bb790 2020-11-20T12:14:07.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.867+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9004112400 con 0x7f90040bb790 2020-11-20T12:14:07.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.867+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9004161740 con 0x7f90040bb790 2020-11-20T12:14:07.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.868+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9004044f60 con 0x7f90040bb790 2020-11-20T12:14:07.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.869+0000 7f8ff17fa700 1 -- 172.21.15.160:0/1890865788 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8ff4025030 con 0x7f90040bb790 2020-11-20T12:14:07.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.870+0000 7f8ff17fa700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8fdc080630 0x7f8fdc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:07.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.870+0000 7f8ff17fa700 1 -- 172.21.15.160:0/1890865788 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f8ff40a3b60 con 0x7f90040bb790 2020-11-20T12:14:07.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.871+0000 7f9009329700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8fdc080630 0x7f8fdc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:07.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.871+0000 7f9009329700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8fdc080630 0x7f8fdc082af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9000006fd0 tx=0x7f9000006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:07.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:07.874+0000 7f8ff17fa700 1 -- 172.21.15.160:0/1890865788 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8ff40789f0 con 0x7f90040bb790 2020-11-20T12:14:08.067 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.064+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9004151fa0 con 0x7f90040bb790 2020-11-20T12:14:08.068 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.065+0000 7f8ff17fa700 1 -- 172.21.15.160:0/1890865788 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8ff4023070 con 0x7f90040bb790 2020-11-20T12:14:08.069 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:08.069 INFO:teuthology.orchestra.run.smithi160.stdout:[ 2020-11-20T12:14:08.069 INFO:teuthology.orchestra.run.smithi160.stdout: { 2020-11-20T12:14:08.069 INFO:teuthology.orchestra.run.smithi160.stdout: "poolnum": 1, 2020-11-20T12:14:08.070 INFO:teuthology.orchestra.run.smithi160.stdout: "poolname": "device_health_metrics" 2020-11-20T12:14:08.070 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:14:08.070 INFO:teuthology.orchestra.run.smithi160.stdout: { 2020-11-20T12:14:08.070 INFO:teuthology.orchestra.run.smithi160.stdout: "poolnum": 2, 2020-11-20T12:14:08.070 INFO:teuthology.orchestra.run.smithi160.stdout: "poolname": "rbd" 2020-11-20T12:14:08.071 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:14:08.071 INFO:teuthology.orchestra.run.smithi160.stdout:] 2020-11-20T12:14:08.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8fdc080630 msgr2=0x7f8fdc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:08.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8fdc080630 0x7f8fdc082af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f9000006fd0 tx=0x7f9000006df0).stop 2020-11-20T12:14:08.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90040bb790 msgr2=0x7f9004063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:08.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90040bb790 0x7f9004063490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8ff4006ef0 tx=0x7f8ff4015000).stop 2020-11-20T12:14:08.073 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 shutdown_connections 2020-11-20T12:14:08.073 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8fdc080630 0x7f8fdc082af0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.073 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f90040c0510 0x7f900414bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.073 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9004061870 0x7f9004160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.073 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 --2- 172.21.15.160:0/1890865788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90040bb790 0x7f9004063490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.074 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 >> 172.21.15.160:0/1890865788 conn(0x7f9004062ef0 msgr2=0x7f900414e540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:08.074 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 shutdown_connections 2020-11-20T12:14:08.074 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.067+0000 7f900a32b700 1 -- 172.21.15.160:0/1890865788 wait complete. 2020-11-20T12:14:08.092 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T12:14:08.093 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-11-20T12:14:08.344 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.340+0000 7f13bb59e700 1 Processor -- start 2020-11-20T12:14:08.344 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.341+0000 7f13bb59e700 1 -- start start 2020-11-20T12:14:08.345 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.342+0000 7f13bb59e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f13bc0bfb50 0x7f13bc0bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:08.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.342+0000 7f13bb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f13bc14e5d0 0x7f13bc0bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:08.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.342+0000 7f13bb59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc0bf3d0 con 0x7f13bc0b9f90 2020-11-20T12:14:08.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.342+0000 7f13bb59e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc0bad90 con 0x7f13bc0bfb50 2020-11-20T12:14:08.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.342+0000 7f13bb59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc14da00 con 0x7f13bc14e5d0 2020-11-20T12:14:08.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13bad9d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f13bc0b9f90 0x7f13bc0bd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55228/0 (socket says 172.21.15.160:55228) 2020-11-20T12:14:08.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13bad9d700 1 -- 172.21.15.160:0/1113329617 learned_addr learned my addr 172.21.15.160:0/1113329617 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:08.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13b9d9b700 1 --2- 172.21.15.160:0/1113329617 >> v2:172.21.15.150:3300/0 conn(0x7f13bc14e5d0 0x7f13bc0bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:08.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13ba59c700 1 --2- 172.21.15.160:0/1113329617 >> v2:172.21.15.134:3300/0 conn(0x7f13bc0bfb50 0x7f13bc0bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:08.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13b959a700 1 -- 172.21.15.160:0/1113329617 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751896892 0 0) 0x7f13bc0bf3d0 con 0x7f13bc0b9f90 2020-11-20T12:14:08.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13b959a700 1 -- 172.21.15.160:0/1113329617 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a0003240 con 0x7f13bc0b9f90 2020-11-20T12:14:08.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13b9d9b700 1 -- 172.21.15.160:0/1113329617 >> v2:172.21.15.134:3300/0 conn(0x7f13bc0bfb50 msgr2=0x7f13bc0bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:08.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13b9d9b700 1 --2- 172.21.15.160:0/1113329617 >> v2:172.21.15.134:3300/0 conn(0x7f13bc0bfb50 0x7f13bc0bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13b9d9b700 1 -- 172.21.15.160:0/1113329617 >> v1:172.21.15.160:6789/0 conn(0x7f13bc0b9f90 legacy=0x7f13bc0bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:08.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.343+0000 7f13b9d9b700 1 -- 172.21.15.160:0/1113329617 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc0ba850 con 0x7f13bc14e5d0 2020-11-20T12:14:08.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.344+0000 7f13b9d9b700 1 --2- 172.21.15.160:0/1113329617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc14e5d0 0x7f13bc0bcd10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f13bc0c0420 tx=0x7f13b0006df0).ready entity=mon.1 client_cookie=8f5d848f4be01e95 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:08.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.344+0000 7f13b959a700 1 -- 172.21.15.160:0/1113329617 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0009640 con 0x7f13bc14e5d0 2020-11-20T12:14:08.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.344+0000 7f13b959a700 1 -- 172.21.15.160:0/1113329617 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b00097a0 con 0x7f13bc14e5d0 2020-11-20T12:14:08.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.344+0000 7f13b959a700 1 -- 172.21.15.160:0/1113329617 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0009b20 con 0x7f13bc14e5d0 2020-11-20T12:14:08.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 -- 172.21.15.160:0/1113329617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc14e5d0 msgr2=0x7f13bc0bcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:08.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 --2- 172.21.15.160:0/1113329617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc14e5d0 0x7f13bc0bcd10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f13bc0c0420 tx=0x7f13b0006df0).stop 2020-11-20T12:14:08.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 -- 172.21.15.160:0/1113329617 shutdown_connections 2020-11-20T12:14:08.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 --2- 172.21.15.160:0/1113329617 >> v2:172.21.15.134:3300/0 conn(0x7f13bc0bfb50 0x7f13bc0bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 --2- 172.21.15.160:0/1113329617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc14e5d0 0x7f13bc0bcd10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 -- 172.21.15.160:0/1113329617 >> 172.21.15.160:0/1113329617 conn(0x7f13bc060140 msgr2=0x7f13bc060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:08.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 -- 172.21.15.160:0/1113329617 shutdown_connections 2020-11-20T12:14:08.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.345+0000 7f13bb59e700 1 -- 172.21.15.160:0/1113329617 wait complete. 2020-11-20T12:14:08.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.346+0000 7f13bb59e700 1 Processor -- start 2020-11-20T12:14:08.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.347+0000 7f13bb59e700 1 -- start start 2020-11-20T12:14:08.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.347+0000 7f13bb59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13bc0b9f90 0x7f13bc160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:08.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13bb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc0bfb50 0x7f13bc0bca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:08.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13bb59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc14e5d0 0x7f13bc1615d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:08.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13bb59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc1610b0 con 0x7f13bc14e5d0 2020-11-20T12:14:08.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13bb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc14b610 con 0x7f13bc0bfb50 2020-11-20T12:14:08.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13bb59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc14ef00 con 0x7f13bc0b9f90 2020-11-20T12:14:08.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13bc0b9f90 0x7f13bc160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:08.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13b9d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc0bfb50 0x7f13bc0bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:08.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13bc0b9f90 0x7f13bc160bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37650/0 (socket says 172.21.15.160:37650) 2020-11-20T12:14:08.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 -- 172.21.15.160:0/872962253 learned_addr learned my addr 172.21.15.160:0/872962253 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:08.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13bad9d700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc14e5d0 0x7f13bc1615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:08.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 -- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc0bfb50 msgr2=0x7f13bc0bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:08.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc0bfb50 0x7f13bc0bca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 -- 172.21.15.160:0/872962253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc14e5d0 msgr2=0x7f13bc1615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:08.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc14e5d0 0x7f13bc1615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:08.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.348+0000 7f13ba59c700 1 -- 172.21.15.160:0/872962253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc14f1a0 con 0x7f13bc0b9f90 2020-11-20T12:14:08.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.349+0000 7f13ba59c700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13bc0b9f90 0x7f13bc160bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f13ac00ef50 tx=0x7f13ac0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:08.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.349+0000 7f13aa7fc700 1 -- 172.21.15.160:0/872962253 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac00cca0 con 0x7f13bc0b9f90 2020-11-20T12:14:08.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.349+0000 7f13aa7fc700 1 -- 172.21.15.160:0/872962253 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac00ce00 con 0x7f13bc0b9f90 2020-11-20T12:14:08.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.349+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc14f440 con 0x7f13bc0b9f90 2020-11-20T12:14:08.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.349+0000 7f13aa7fc700 1 -- 172.21.15.160:0/872962253 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac012600 con 0x7f13bc0b9f90 2020-11-20T12:14:08.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.349+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc14f980 con 0x7f13bc0b9f90 2020-11-20T12:14:08.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.350+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc14fb80 con 0x7f13bc0b9f90 2020-11-20T12:14:08.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.351+0000 7f13aa7fc700 1 -- 172.21.15.160:0/872962253 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f13ac022070 con 0x7f13bc0b9f90 2020-11-20T12:14:08.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.352+0000 7f13aa7fc700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1390080630 0x7f1390082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:08.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.352+0000 7f13aa7fc700 1 -- 172.21.15.160:0/872962253 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f13ac0a2d90 con 0x7f13bc0b9f90 2020-11-20T12:14:08.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.352+0000 7f13b9d9b700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1390080630 0x7f1390082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:08.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.353+0000 7f13b9d9b700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1390080630 0x7f1390082af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f13bc14ea30 tx=0x7f13b0015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:08.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.355+0000 7f13aa7fc700 1 -- 172.21.15.160:0/872962253 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f13bc14fb80 con 0x7f13bc0b9f90 2020-11-20T12:14:08.545 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:08.542+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f13bc044f60 con 0x7f13bc0b9f90 2020-11-20T12:14:09.318 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.314+0000 7f13aa7fc700 1 -- 172.21.15.160:0/872962253 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v23) v1 ==== 133+0+0 (secure 0 0 0) 0x7f13ac016070 con 0x7f13bc0b9f90 2020-11-20T12:14:09.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.318+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1390080630 msgr2=0x7f1390082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:09.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.318+0000 7f13bb59e700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1390080630 0x7f1390082af0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f13bc14ea30 tx=0x7f13b0015000).stop 2020-11-20T12:14:09.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.318+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13bc0b9f90 msgr2=0x7f13bc160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:09.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.318+0000 7f13bb59e700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13bc0b9f90 0x7f13bc160bc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f13ac00ef50 tx=0x7f13ac0091d0).stop 2020-11-20T12:14:09.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.319+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 shutdown_connections 2020-11-20T12:14:09.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.319+0000 7f13bb59e700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1390080630 0x7f1390082af0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:09.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.319+0000 7f13bb59e700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13bc14e5d0 0x7f13bc1615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:09.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.319+0000 7f13bb59e700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13bc0b9f90 0x7f13bc160bc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:09.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.319+0000 7f13bb59e700 1 --2- 172.21.15.160:0/872962253 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13bc0bfb50 0x7f13bc0bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:09.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.319+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 >> 172.21.15.160:0/872962253 conn(0x7f13bc060140 msgr2=0x7f13bc148eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:09.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.319+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 shutdown_connections 2020-11-20T12:14:09.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.320+0000 7f13bb59e700 1 -- 172.21.15.160:0/872962253 wait complete. 2020-11-20T12:14:09.415 INFO:teuthology.orchestra.run.smithi160.stderr:pool 'cephfs_metadata' created 2020-11-20T12:14:09.415 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2020-11-20T12:14:09.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.668+0000 7fea7359e700 1 Processor -- start 2020-11-20T12:14:09.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.668+0000 7fea7359e700 1 -- start start 2020-11-20T12:14:09.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea7359e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea74152770 0x7fea740be030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:09.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea7359e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea740bef40 con 0x7fea740bdc50 2020-11-20T12:14:09.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea7359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea741554e0 con 0x7fea741592a0 2020-11-20T12:14:09.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea7359e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea74155780 con 0x7fea74152770 2020-11-20T12:14:09.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea69d9b700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fea741592a0 0x7fea74152060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46502/0 (socket says 172.21.15.160:46502) 2020-11-20T12:14:09.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea72d9d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fea74152770 0x7fea740be030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:09.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea69d9b700 1 -- 172.21.15.160:0/1186186268 learned_addr learned my addr 172.21.15.160:0/1186186268 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:09.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea71d9b700 1 -- 172.21.15.160:0/1186186268 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375767425 0 0) 0x7fea740bef40 con 0x7fea740bdc50 2020-11-20T12:14:09.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea71d9b700 1 -- 172.21.15.160:0/1186186268 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea54003240 con 0x7fea740bdc50 2020-11-20T12:14:09.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea71d9b700 1 -- 172.21.15.160:0/1186186268 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087432570 0 0) 0x7fea741554e0 con 0x7fea741592a0 2020-11-20T12:14:09.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.670+0000 7fea71d9b700 1 -- 172.21.15.160:0/1186186268 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea740bef40 con 0x7fea741592a0 2020-11-20T12:14:09.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.671+0000 7fea72d9d700 1 -- 172.21.15.160:0/1186186268 >> v1:172.21.15.150:6789/0 conn(0x7fea741592a0 legacy=0x7fea74152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:09.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.671+0000 7fea72d9d700 1 -- 172.21.15.160:0/1186186268 >> v1:172.21.15.134:6789/0 conn(0x7fea740bdc50 legacy=0x7fea740badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:09.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.671+0000 7fea72d9d700 1 -- 172.21.15.160:0/1186186268 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea74155a20 con 0x7fea74152770 2020-11-20T12:14:09.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.671+0000 7fea72d9d700 1 --2- 172.21.15.160:0/1186186268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740be030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fea6c00b9a0 tx=0x7fea6c006df0).ready entity=mon.0 client_cookie=2c084f5b7b03736a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:09.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.671+0000 7fea71d9b700 1 -- 172.21.15.160:0/1186186268 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c009680 con 0x7fea74152770 2020-11-20T12:14:09.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.671+0000 7fea71d9b700 1 -- 172.21.15.160:0/1186186268 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c0097e0 con 0x7fea74152770 2020-11-20T12:14:09.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.671+0000 7fea71d9b700 1 -- 172.21.15.160:0/1186186268 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c009b60 con 0x7fea74152770 2020-11-20T12:14:09.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.672+0000 7fea7359e700 1 -- 172.21.15.160:0/1186186268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 msgr2=0x7fea740be030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:09.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.672+0000 7fea7359e700 1 --2- 172.21.15.160:0/1186186268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740be030 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fea6c00b9a0 tx=0x7fea6c006df0).stop 2020-11-20T12:14:09.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.672+0000 7fea7359e700 1 -- 172.21.15.160:0/1186186268 shutdown_connections 2020-11-20T12:14:09.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.672+0000 7fea7359e700 1 --2- 172.21.15.160:0/1186186268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740be030 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:09.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.672+0000 7fea7359e700 1 -- 172.21.15.160:0/1186186268 >> 172.21.15.160:0/1186186268 conn(0x7fea74060140 msgr2=0x7fea74060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:09.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.672+0000 7fea7359e700 1 -- 172.21.15.160:0/1186186268 shutdown_connections 2020-11-20T12:14:09.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.672+0000 7fea7359e700 1 -- 172.21.15.160:0/1186186268 wait complete. 2020-11-20T12:14:09.691 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.674+0000 7fea7359e700 1 Processor -- start 2020-11-20T12:14:09.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.674+0000 7fea7359e700 1 -- start start 2020-11-20T12:14:09.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea7359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea740bdc50 0x7fea741680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:09.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea7359e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:09.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea7359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea741592a0 0x7fea740bf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:09.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea7359e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea741650b0 con 0x7fea74152770 2020-11-20T12:14:09.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea7359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea741685d0 con 0x7fea741592a0 2020-11-20T12:14:09.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea7359e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea741590e0 con 0x7fea740bdc50 2020-11-20T12:14:09.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea69d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:09.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea7259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea740bdc50 0x7fea741680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:09.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea72d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea741592a0 0x7fea740bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:09.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea69d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60188/0 (socket says 172.21.15.160:60188) 2020-11-20T12:14:09.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea69d9b700 1 -- 172.21.15.160:0/144101369 learned_addr learned my addr 172.21.15.160:0/144101369 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:09.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.675+0000 7fea72d9d700 1 -- 172.21.15.160:0/144101369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea740bdc50 msgr2=0x7fea741680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:09.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea72d9d700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea740bdc50 0x7fea741680e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:09.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea72d9d700 1 -- 172.21.15.160:0/144101369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 msgr2=0x7fea740c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:09.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea72d9d700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:09.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea72d9d700 1 -- 172.21.15.160:0/144101369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740c24f0 con 0x7fea741592a0 2020-11-20T12:14:09.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea72d9d700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea741592a0 0x7fea740bf760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fea6c012000 tx=0x7fea6c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:09.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea6affd700 1 -- 172.21.15.160:0/144101369 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c01e460 con 0x7fea741592a0 2020-11-20T12:14:09.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea6affd700 1 -- 172.21.15.160:0/144101369 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6c01e5c0 con 0x7fea741592a0 2020-11-20T12:14:09.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea6affd700 1 -- 172.21.15.160:0/144101369 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6c01e940 con 0x7fea741592a0 2020-11-20T12:14:09.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea740c2790 con 0x7fea741592a0 2020-11-20T12:14:09.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.676+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea741646d0 con 0x7fea741592a0 2020-11-20T12:14:09.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.677+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea74044f60 con 0x7fea741592a0 2020-11-20T12:14:09.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.679+0000 7fea6affd700 1 -- 172.21.15.160:0/144101369 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fea6c01a040 con 0x7fea741592a0 2020-11-20T12:14:09.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.679+0000 7fea6affd700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fea50080630 0x7fea50082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:09.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.680+0000 7fea6affd700 1 -- 172.21.15.160:0/144101369 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7447+0+0 (secure 0 0 0) 0x7fea6c0a3fc0 con 0x7fea741592a0 2020-11-20T12:14:09.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.680+0000 7fea7259c700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fea50080630 0x7fea50082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:09.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.680+0000 7fea7259c700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fea50080630 0x7fea50082af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fea7414ee90 tx=0x7fea64007da0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:09.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.682+0000 7fea6affd700 1 -- 172.21.15.160:0/144101369 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fea6c06afd0 con 0x7fea741592a0 2020-11-20T12:14:09.870 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:09.867+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fea74111860 con 0x7fea741592a0 2020-11-20T12:14:10.335 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.331+0000 7fea6affd700 1 -- 172.21.15.160:0/144101369 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v24) v1 ==== 125+0+0 (secure 0 0 0) 0x7fea6c023030 con 0x7fea741592a0 2020-11-20T12:14:10.345 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.339+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fea50080630 msgr2=0x7fea50082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.345 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.339+0000 7fea7359e700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fea50080630 0x7fea50082af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fea7414ee90 tx=0x7fea64007da0).stop 2020-11-20T12:14:10.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.339+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea741592a0 msgr2=0x7fea740bf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.339+0000 7fea7359e700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea741592a0 0x7fea740bf760 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fea6c012000 tx=0x7fea6c015000).stop 2020-11-20T12:14:10.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.340+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 shutdown_connections 2020-11-20T12:14:10.346 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.340+0000 7fea7359e700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fea50080630 0x7fea50082af0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.340+0000 7fea7359e700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fea741592a0 0x7fea740bf760 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.340+0000 7fea7359e700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea740bdc50 0x7fea741680e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.340+0000 7fea7359e700 1 --2- 172.21.15.160:0/144101369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea74152770 0x7fea740c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.340+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 >> 172.21.15.160:0/144101369 conn(0x7fea74060140 msgr2=0x7fea74150500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:10.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.341+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 shutdown_connections 2020-11-20T12:14:10.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.342+0000 7fea7359e700 1 -- 172.21.15.160:0/144101369 wait complete. 2020-11-20T12:14:10.348 INFO:teuthology.orchestra.run.smithi160.stderr:pool 'cephfs_data' created 2020-11-20T12:14:10.371 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T12:14:10.615 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.611+0000 7fa619d6f700 1 Processor -- start 2020-11-20T12:14:10.616 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.612+0000 7fa619d6f700 1 -- start start 2020-11-20T12:14:10.616 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.613+0000 7fa619d6f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa6140bf780 0x7fa6140bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.613+0000 7fa619d6f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa6140c7aa0 0x7fa6140bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.613+0000 7fa619d6f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa614151b20 con 0x7fa6140616b0 2020-11-20T12:14:10.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.613+0000 7fa619d6f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa614151340 con 0x7fa6140bf780 2020-11-20T12:14:10.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.613+0000 7fa619d6f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6141515e0 con 0x7fa6140c7aa0 2020-11-20T12:14:10.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa60bfff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fa6140616b0 0x7fa614150b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55254/0 (socket says 172.21.15.160:55254) 2020-11-20T12:14:10.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa60bfff700 1 -- 172.21.15.160:0/2776306328 learned_addr learned my addr 172.21.15.160:0/2776306328 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:10.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa618d6d700 1 --2- 172.21.15.160:0/2776306328 >> v2:172.21.15.134:3300/0 conn(0x7fa6140bf780 0x7fa6140bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa61956e700 1 --2- 172.21.15.160:0/2776306328 >> v2:172.21.15.150:3300/0 conn(0x7fa6140c7aa0 0x7fa6140bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa60b7fe700 1 -- 172.21.15.160:0/2776306328 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520483699 0 0) 0x7fa614151b20 con 0x7fa6140616b0 2020-11-20T12:14:10.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa618d6d700 1 -- 172.21.15.160:0/2776306328 >> v2:172.21.15.150:3300/0 conn(0x7fa6140c7aa0 msgr2=0x7fa6140bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:10.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa618d6d700 1 --2- 172.21.15.160:0/2776306328 >> v2:172.21.15.150:3300/0 conn(0x7fa6140c7aa0 0x7fa6140bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa618d6d700 1 -- 172.21.15.160:0/2776306328 >> v1:172.21.15.160:6789/0 conn(0x7fa6140616b0 legacy=0x7fa614150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa618d6d700 1 -- 172.21.15.160:0/2776306328 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614151880 con 0x7fa6140bf780 2020-11-20T12:14:10.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.614+0000 7fa61956e700 1 --2- 172.21.15.160:0/2776306328 >> v2:172.21.15.150:3300/0 conn(0x7fa6140c7aa0 0x7fa6140bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:10.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.615+0000 7fa618d6d700 1 --2- 172.21.15.160:0/2776306328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140bf780 0x7fa6140bfb60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa614061af0 tx=0x7fa610006df0).ready entity=mon.0 client_cookie=c9910dff7e1b299a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:10.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.615+0000 7fa60b7fe700 1 -- 172.21.15.160:0/2776306328 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6100097b0 con 0x7fa6140bf780 2020-11-20T12:14:10.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.615+0000 7fa60b7fe700 1 -- 172.21.15.160:0/2776306328 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610009910 con 0x7fa6140bf780 2020-11-20T12:14:10.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.615+0000 7fa60b7fe700 1 -- 172.21.15.160:0/2776306328 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610009c90 con 0x7fa6140bf780 2020-11-20T12:14:10.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 -- 172.21.15.160:0/2776306328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140bf780 msgr2=0x7fa6140bfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 --2- 172.21.15.160:0/2776306328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140bf780 0x7fa6140bfb60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fa614061af0 tx=0x7fa610006df0).stop 2020-11-20T12:14:10.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 -- 172.21.15.160:0/2776306328 shutdown_connections 2020-11-20T12:14:10.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 --2- 172.21.15.160:0/2776306328 >> v2:172.21.15.150:3300/0 conn(0x7fa6140c7aa0 0x7fa6140bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 --2- 172.21.15.160:0/2776306328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140bf780 0x7fa6140bfb60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 -- 172.21.15.160:0/2776306328 >> 172.21.15.160:0/2776306328 conn(0x7fa6140639d0 msgr2=0x7fa6140c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:10.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 -- 172.21.15.160:0/2776306328 shutdown_connections 2020-11-20T12:14:10.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.616+0000 7fa619d6f700 1 -- 172.21.15.160:0/2776306328 wait complete. 2020-11-20T12:14:10.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.617+0000 7fa619d6f700 1 Processor -- start 2020-11-20T12:14:10.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.618+0000 7fa619d6f700 1 -- start start 2020-11-20T12:14:10.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.618+0000 7fa619d6f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6140616b0 0x7fa614112210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.618+0000 7fa619d6f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140bf780 0x7fa614112700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.618+0000 7fa619d6f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140c7aa0 0x7fa61414b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.618+0000 7fa619d6f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61414dc10 con 0x7fa6140c7aa0 2020-11-20T12:14:10.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.618+0000 7fa619d6f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61414deb0 con 0x7fa6140bf780 2020-11-20T12:14:10.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.618+0000 7fa619d6f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61414e150 con 0x7fa6140616b0 2020-11-20T12:14:10.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6140616b0 0x7fa614112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6140616b0 0x7fa614112210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37678/0 (socket says 172.21.15.160:37678) 2020-11-20T12:14:10.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 -- 172.21.15.160:0/4180973856 learned_addr learned my addr 172.21.15.160:0/4180973856 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:10.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa60bfff700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140bf780 0x7fa614112700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa61956e700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140c7aa0 0x7fa61414b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 -- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140bf780 msgr2=0x7fa614112700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140bf780 0x7fa614112700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 -- 172.21.15.160:0/4180973856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140c7aa0 msgr2=0x7fa61414b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140c7aa0 0x7fa61414b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa618d6d700 1 -- 172.21.15.160:0/4180973856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61414e3f0 con 0x7fa6140616b0 2020-11-20T12:14:10.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.619+0000 7fa60bfff700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140bf780 0x7fa614112700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:10.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.620+0000 7fa618d6d700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6140616b0 0x7fa614112210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa6100098e0 tx=0x7fa610015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:10.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.620+0000 7fa608ff9700 1 -- 172.21.15.160:0/4180973856 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610011d50 con 0x7fa6140616b0 2020-11-20T12:14:10.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.620+0000 7fa608ff9700 1 -- 172.21.15.160:0/4180973856 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61001e460 con 0x7fa6140616b0 2020-11-20T12:14:10.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.620+0000 7fa608ff9700 1 -- 172.21.15.160:0/4180973856 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61001e7e0 con 0x7fa6140616b0 2020-11-20T12:14:10.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.620+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61414e690 con 0x7fa6140616b0 2020-11-20T12:14:10.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.620+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61414ef30 con 0x7fa6140616b0 2020-11-20T12:14:10.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.621+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa614069460 con 0x7fa6140616b0 2020-11-20T12:14:10.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.622+0000 7fa608ff9700 1 -- 172.21.15.160:0/4180973856 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa61001a040 con 0x7fa6140616b0 2020-11-20T12:14:10.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.623+0000 7fa608ff9700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa5ec080660 0x7fa5ec082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.624+0000 7fa608ff9700 1 -- 172.21.15.160:0/4180973856 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7797+0+0 (secure 0 0 0) 0x7fa6100a3b80 con 0x7fa6140616b0 2020-11-20T12:14:10.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.624+0000 7fa60bfff700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa5ec080660 0x7fa5ec082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.624+0000 7fa60bfff700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa5ec080660 0x7fa5ec082b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa614150890 tx=0x7fa604009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:10.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.627+0000 7fa608ff9700 1 -- 172.21.15.160:0/4180973856 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa6100786e0 con 0x7fa6140616b0 2020-11-20T12:14:10.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.875+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fa6140c81b0 con 0x7fa6140616b0 2020-11-20T12:14:10.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.886+0000 7fa608ff9700 1 -- 172.21.15.160:0/4180973856 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7fa6100a3e60 con 0x7fa6140616b0 2020-11-20T12:14:10.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.895+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa5ec080660 msgr2=0x7fa5ec082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.895+0000 7fa619d6f700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa5ec080660 0x7fa5ec082b20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa614150890 tx=0x7fa604009040).stop 2020-11-20T12:14:10.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.895+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6140616b0 msgr2=0x7fa614112210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:10.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.895+0000 7fa619d6f700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6140616b0 0x7fa614112210 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fa6100098e0 tx=0x7fa610015000).stop 2020-11-20T12:14:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.898+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 shutdown_connections 2020-11-20T12:14:10.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.898+0000 7fa619d6f700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa5ec080660 0x7fa5ec082b20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.898+0000 7fa619d6f700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6140c7aa0 0x7fa61414b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.898+0000 7fa619d6f700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6140616b0 0x7fa614112210 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.898+0000 7fa619d6f700 1 --2- 172.21.15.160:0/4180973856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6140bf780 0x7fa614112700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:10.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.898+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 >> 172.21.15.160:0/4180973856 conn(0x7fa6140639d0 msgr2=0x7fa6140c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:10.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.898+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 shutdown_connections 2020-11-20T12:14:10.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:10.899+0000 7fa619d6f700 1 -- 172.21.15.160:0/4180973856 wait complete. 2020-11-20T12:14:10.904 INFO:teuthology.orchestra.run.smithi160.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T12:14:10.925 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:11.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.151+0000 7f43c5865700 1 Processor -- start 2020-11-20T12:14:11.155 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.151+0000 7f43c5865700 1 -- start start 2020-11-20T12:14:11.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43c5865700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f43c0064fc0 0x7f43c00653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43c5865700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f43c00bbaf0 0x7f43c00bd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43c5865700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c00bc060 con 0x7f43c0151500 2020-11-20T12:14:11.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43c5865700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00bc300 con 0x7f43c00bbaf0 2020-11-20T12:14:11.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43c5865700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c0150880 con 0x7f43c0064fc0 2020-11-20T12:14:11.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43bffff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f43c0151500 0x7f43c00616b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60004/0 (socket says 172.21.15.160:60004) 2020-11-20T12:14:11.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43bffff700 1 -- 172.21.15.160:0/1672472365 learned_addr learned my addr 172.21.15.160:0/1672472365 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:11.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43c5064700 1 --2- 172.21.15.160:0/1672472365 >> v2:172.21.15.134:3300/0 conn(0x7f43c00bbaf0 0x7f43c00bd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43c4863700 1 --2- 172.21.15.160:0/1672472365 >> v2:172.21.15.150:3300/0 conn(0x7f43c0064fc0 0x7f43c00653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43bf7fe700 1 -- 172.21.15.160:0/1672472365 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043750322 0 0) 0x7f43c00bc060 con 0x7f43c0151500 2020-11-20T12:14:11.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.153+0000 7f43bf7fe700 1 -- 172.21.15.160:0/1672472365 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a8003240 con 0x7f43c0151500 2020-11-20T12:14:11.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43c5064700 1 -- 172.21.15.160:0/1672472365 >> v2:172.21.15.150:3300/0 conn(0x7f43c0064fc0 msgr2=0x7f43c00653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:11.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43c5064700 1 --2- 172.21.15.160:0/1672472365 >> v2:172.21.15.150:3300/0 conn(0x7f43c0064fc0 0x7f43c00653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43c5064700 1 -- 172.21.15.160:0/1672472365 >> v1:172.21.15.134:6789/0 conn(0x7f43c0151500 legacy=0x7f43c00616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43c5064700 1 -- 172.21.15.160:0/1672472365 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0150b20 con 0x7f43c00bbaf0 2020-11-20T12:14:11.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43c4863700 1 --2- 172.21.15.160:0/1672472365 >> v2:172.21.15.150:3300/0 conn(0x7f43c0064fc0 0x7f43c00653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:11.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43c5064700 1 --2- 172.21.15.160:0/1672472365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c00bbaf0 0x7f43c00bd290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f43c005c2a0 tx=0x7f43b80091d0).ready entity=mon.0 client_cookie=c3876a3b50843f1b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:11.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43bf7fe700 1 -- 172.21.15.160:0/1672472365 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800ba20 con 0x7f43c00bbaf0 2020-11-20T12:14:11.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43bf7fe700 1 -- 172.21.15.160:0/1672472365 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800bb80 con 0x7f43c00bbaf0 2020-11-20T12:14:11.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.154+0000 7f43bf7fe700 1 -- 172.21.15.160:0/1672472365 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b8011400 con 0x7f43c00bbaf0 2020-11-20T12:14:11.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 -- 172.21.15.160:0/1672472365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c00bbaf0 msgr2=0x7f43c00bd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 --2- 172.21.15.160:0/1672472365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c00bbaf0 0x7f43c00bd290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f43c005c2a0 tx=0x7f43b80091d0).stop 2020-11-20T12:14:11.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 -- 172.21.15.160:0/1672472365 shutdown_connections 2020-11-20T12:14:11.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 --2- 172.21.15.160:0/1672472365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c00bbaf0 0x7f43c00bd290 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 --2- 172.21.15.160:0/1672472365 >> v2:172.21.15.150:3300/0 conn(0x7f43c0064fc0 0x7f43c00653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 -- 172.21.15.160:0/1672472365 >> 172.21.15.160:0/1672472365 conn(0x7f43c0062ef0 msgr2=0x7f43c0063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:11.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 -- 172.21.15.160:0/1672472365 shutdown_connections 2020-11-20T12:14:11.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.155+0000 7f43c5865700 1 -- 172.21.15.160:0/1672472365 wait complete. 2020-11-20T12:14:11.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.157+0000 7f43c5865700 1 Processor -- start 2020-11-20T12:14:11.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.157+0000 7f43c5865700 1 -- start start 2020-11-20T12:14:11.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c5865700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43c0064fc0 0x7f43c014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c5865700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c00bbaf0 0x7f43c0061dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c5865700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c0151500 0x7f43c015fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c5865700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c01606b0 con 0x7f43c0151500 2020-11-20T12:14:11.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c5865700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0160950 con 0x7f43c00bbaf0 2020-11-20T12:14:11.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c5865700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c00bdca0 con 0x7f43c0064fc0 2020-11-20T12:14:11.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c4863700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43c0064fc0 0x7f43c014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43bffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c00bbaf0 0x7f43c0061dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c4863700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43c0064fc0 0x7f43c014ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37704/0 (socket says 172.21.15.160:37704) 2020-11-20T12:14:11.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c4863700 1 -- 172.21.15.160:0/1421765161 learned_addr learned my addr 172.21.15.160:0/1421765161 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:11.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.158+0000 7f43c5064700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c0151500 0x7f43c015fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bffff700 1 -- 172.21.15.160:0/1421765161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43c0064fc0 msgr2=0x7f43c014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bffff700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43c0064fc0 0x7f43c014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bffff700 1 -- 172.21.15.160:0/1421765161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c0151500 msgr2=0x7f43c015fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bffff700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c0151500 0x7f43c015fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bffff700 1 -- 172.21.15.160:0/1421765161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c00bdf40 con 0x7f43c00bbaf0 2020-11-20T12:14:11.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43c4863700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43c0064fc0 0x7f43c014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:11.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bffff700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c00bbaf0 0x7f43c0061dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f43ac00c6e0 tx=0x7f43ac0079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:11.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bcff9700 1 -- 172.21.15.160:0/1421765161 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0072e0 con 0x7f43c00bbaf0 2020-11-20T12:14:11.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bcff9700 1 -- 172.21.15.160:0/1421765161 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac007460 con 0x7f43c00bbaf0 2020-11-20T12:14:11.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c00be1e0 con 0x7f43c00bbaf0 2020-11-20T12:14:11.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43bcff9700 1 -- 172.21.15.160:0/1421765161 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac005840 con 0x7f43c00bbaf0 2020-11-20T12:14:11.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.159+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c00c1310 con 0x7f43c00bbaf0 2020-11-20T12:14:11.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.160+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c00be3a0 con 0x7f43c00bbaf0 2020-11-20T12:14:11.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.162+0000 7f43bcff9700 1 -- 172.21.15.160:0/1421765161 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f43ac010070 con 0x7f43c00bbaf0 2020-11-20T12:14:11.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.163+0000 7f43bcff9700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4394080630 0x7f4394082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.163+0000 7f43bcff9700 1 -- 172.21.15.160:0/1421765161 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f43ac0a1f20 con 0x7f43c00bbaf0 2020-11-20T12:14:11.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.163+0000 7f43c4863700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4394080630 0x7f4394082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.164+0000 7f43c4863700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4394080630 0x7f4394082af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f43b000f780 tx=0x7f43b0008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:11.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.165+0000 7f43bcff9700 1 -- 172.21.15.160:0/1421765161 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f43ac076b20 con 0x7f43c00bbaf0 2020-11-20T12:14:11.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.354+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43c0044f60 con 0x7f43c00bbaf0 2020-11-20T12:14:11.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.356+0000 7f43bcff9700 1 -- 172.21.15.160:0/1421765161 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+21595 (secure 0 0 0) 0x7f43ac07a140 con 0x7f43c00bbaf0 2020-11-20T12:14:11.360 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:11.360 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":25,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:10.877797+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:11.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.358+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4394080630 msgr2=0x7f4394082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.358+0000 7f43c5865700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4394080630 0x7f4394082af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f43b000f780 tx=0x7f43b0008040).stop 2020-11-20T12:14:11.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c00bbaf0 msgr2=0x7f43c0061dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c00bbaf0 0x7f43c0061dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f43ac00c6e0 tx=0x7f43ac0079e0).stop 2020-11-20T12:14:11.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 shutdown_connections 2020-11-20T12:14:11.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4394080630 0x7f4394082af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c0151500 0x7f43c015fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43c0064fc0 0x7f43c014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 --2- 172.21.15.160:0/1421765161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43c00bbaf0 0x7f43c0061dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 >> 172.21.15.160:0/1421765161 conn(0x7f43c0062ef0 msgr2=0x7f43c0147ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:11.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 shutdown_connections 2020-11-20T12:14:11.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.359+0000 7f43c5865700 1 -- 172.21.15.160:0/1421765161 wait complete. 2020-11-20T12:14:11.387 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:11.643 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.638+0000 7f234b59e700 1 Processor -- start 2020-11-20T12:14:11.643 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.639+0000 7f234b59e700 1 -- start start 2020-11-20T12:14:11.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.640+0000 7f234b59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f234c0bfb70 0x7f234c0bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.640+0000 7f234b59e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f234c0bbfb0 0x7f234c0657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.640+0000 7f234b59e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c0bc440 con 0x7f234c155270 2020-11-20T12:14:11.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.640+0000 7f234b59e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c155b30 con 0x7f234c0bbfb0 2020-11-20T12:14:11.646 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.640+0000 7f234b59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c155dd0 con 0x7f234c0bfb70 2020-11-20T12:14:11.646 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f2349d9b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f234c0bbfb0 0x7f234c0657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.646 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f234ad9d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f234c155270 0x7f234c0619c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60018/0 (socket says 172.21.15.160:60018) 2020-11-20T12:14:11.646 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f234ad9d700 1 -- 172.21.15.160:0/686917038 learned_addr learned my addr 172.21.15.160:0/686917038 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:11.646 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f234a59c700 1 --2- 172.21.15.160:0/686917038 >> v2:172.21.15.160:3300/0 conn(0x7f234c0bfb70 0x7f234c0bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f2349d9b700 1 -- 172.21.15.160:0/686917038 >> v2:172.21.15.160:3300/0 conn(0x7f234c0bfb70 msgr2=0x7f234c0bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:11.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f2349d9b700 1 --2- 172.21.15.160:0/686917038 >> v2:172.21.15.160:3300/0 conn(0x7f234c0bfb70 0x7f234c0bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f2349d9b700 1 -- 172.21.15.160:0/686917038 >> v1:172.21.15.134:6789/0 conn(0x7f234c155270 legacy=0x7f234c0619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f234959a700 1 -- 172.21.15.160:0/686917038 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901044620 0 0) 0x7f234c0bc440 con 0x7f234c155270 2020-11-20T12:14:11.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f2349d9b700 1 -- 172.21.15.160:0/686917038 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c156070 con 0x7f234c0bbfb0 2020-11-20T12:14:11.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f234a59c700 1 --2- 172.21.15.160:0/686917038 >> v2:172.21.15.160:3300/0 conn(0x7f234c0bfb70 0x7f234c0bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:11.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.641+0000 7f2349d9b700 1 --2- 172.21.15.160:0/686917038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c0657e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f234c05c2a0 tx=0x7f2340006df0).ready entity=mon.0 client_cookie=cadf9add10e53b78 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:11.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234959a700 1 -- 172.21.15.160:0/686917038 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340009840 con 0x7f234c0bbfb0 2020-11-20T12:14:11.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234959a700 1 -- 172.21.15.160:0/686917038 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23400099a0 con 0x7f234c0bbfb0 2020-11-20T12:14:11.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234959a700 1 -- 172.21.15.160:0/686917038 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340009d20 con 0x7f234c0bbfb0 2020-11-20T12:14:11.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234b59e700 1 -- 172.21.15.160:0/686917038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 msgr2=0x7f234c0657e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234b59e700 1 --2- 172.21.15.160:0/686917038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c0657e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f234c05c2a0 tx=0x7f2340006df0).stop 2020-11-20T12:14:11.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234b59e700 1 -- 172.21.15.160:0/686917038 shutdown_connections 2020-11-20T12:14:11.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234b59e700 1 --2- 172.21.15.160:0/686917038 >> v2:172.21.15.160:3300/0 conn(0x7f234c0bfb70 0x7f234c0bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234b59e700 1 --2- 172.21.15.160:0/686917038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c0657e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.642+0000 7f234b59e700 1 -- 172.21.15.160:0/686917038 >> 172.21.15.160:0/686917038 conn(0x7f234c062ef0 msgr2=0x7f234c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:11.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.643+0000 7f234b59e700 1 -- 172.21.15.160:0/686917038 shutdown_connections 2020-11-20T12:14:11.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.643+0000 7f234b59e700 1 -- 172.21.15.160:0/686917038 wait complete. 2020-11-20T12:14:11.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.644+0000 7f234b59e700 1 Processor -- start 2020-11-20T12:14:11.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.645+0000 7f234b59e700 1 -- start start 2020-11-20T12:14:11.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234b59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234c0bfb70 0x7f234c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c155270 0x7f234c1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234b59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c168010 con 0x7f234c0bbfb0 2020-11-20T12:14:11.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c1682b0 con 0x7f234c155270 2020-11-20T12:14:11.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234b59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c168550 con 0x7f234c0bfb70 2020-11-20T12:14:11.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f2349d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234c0bfb70 0x7f234c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f2349d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234c0bfb70 0x7f234c1584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37720/0 (socket says 172.21.15.160:37720) 2020-11-20T12:14:11.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60238/0 (socket says 172.21.15.160:60238) 2020-11-20T12:14:11.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f2349d9b700 1 -- 172.21.15.160:0/517056885 learned_addr learned my addr 172.21.15.160:0/517056885 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:11.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.646+0000 7f234ad9d700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c155270 0x7f234c1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234a59c700 1 -- 172.21.15.160:0/517056885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234c0bfb70 msgr2=0x7f234c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234a59c700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234c0bfb70 0x7f234c1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234a59c700 1 -- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c155270 msgr2=0x7f234c1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234a59c700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c155270 0x7f234c1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234a59c700 1 -- 172.21.15.160:0/517056885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c1687f0 con 0x7f234c0bbfb0 2020-11-20T12:14:11.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f2349d9b700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234c0bfb70 0x7f234c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:11.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234ad9d700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c155270 0x7f234c1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:11.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234a59c700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c149b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f233c00c8f0 tx=0x7f233c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:11.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f233a7fc700 1 -- 172.21.15.160:0/517056885 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00e5d0 con 0x7f234c0bbfb0 2020-11-20T12:14:11.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f233a7fc700 1 -- 172.21.15.160:0/517056885 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00e730 con 0x7f234c0bbfb0 2020-11-20T12:14:11.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c14a550 con 0x7f234c0bbfb0 2020-11-20T12:14:11.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.647+0000 7f233a7fc700 1 -- 172.21.15.160:0/517056885 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c00eab0 con 0x7f234c0bbfb0 2020-11-20T12:14:11.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.648+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c165a40 con 0x7f234c0bbfb0 2020-11-20T12:14:11.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.649+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c0bea30 con 0x7f234c0bbfb0 2020-11-20T12:14:11.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.650+0000 7f233a7fc700 1 -- 172.21.15.160:0/517056885 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f233c01b460 con 0x7f234c0bbfb0 2020-11-20T12:14:11.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.651+0000 7f233a7fc700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2320080630 0x7f2320082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:11.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.651+0000 7f233a7fc700 1 -- 172.21.15.160:0/517056885 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f233c0a2930 con 0x7f234c0bbfb0 2020-11-20T12:14:11.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.651+0000 7f2349d9b700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2320080630 0x7f2320082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.652+0000 7f2349d9b700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2320080630 0x7f2320082af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2340006e30 tx=0x7f2340015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:11.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.655+0000 7f233a7fc700 1 -- 172.21.15.160:0/517056885 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f234c0bea30 con 0x7f234c0bbfb0 2020-11-20T12:14:11.844 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.841+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f234c0bea30 con 0x7f234c0bbfb0 2020-11-20T12:14:11.845 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.842+0000 7f233a7fc700 1 -- 172.21.15.160:0/517056885 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+21595 (secure 0 0 0) 0x7f234c0bea30 con 0x7f234c0bbfb0 2020-11-20T12:14:11.846 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:11.846 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":25,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:10.877797+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:11.848 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.844+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2320080630 msgr2=0x7f2320082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.848 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.844+0000 7f234b59e700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2320080630 0x7f2320082af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2340006e30 tx=0x7f2340015000).stop 2020-11-20T12:14:11.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 msgr2=0x7f234c149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:11.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c149b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f233c00c8f0 tx=0x7f233c008040).stop 2020-11-20T12:14:11.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 shutdown_connections 2020-11-20T12:14:11.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2320080630 0x7f2320082af0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.850 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f234c155270 0x7f234c1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.850 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f234c0bbfb0 0x7f234c149b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.850 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 --2- 172.21.15.160:0/517056885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f234c0bfb70 0x7f234c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:11.850 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 >> 172.21.15.160:0/517056885 conn(0x7f234c062ef0 msgr2=0x7f234c0befb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:11.850 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 shutdown_connections 2020-11-20T12:14:11.851 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:11.845+0000 7f234b59e700 1 -- 172.21.15.160:0/517056885 wait complete. 2020-11-20T12:14:11.872 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-11-20T12:14:12.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.112+0000 7f12ee86a700 1 Processor -- start 2020-11-20T12:14:12.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.113+0000 7f12ee86a700 1 -- start start 2020-11-20T12:14:12.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.114+0000 7f12ee86a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f12e80bfb50 0x7f12e80bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:12.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.114+0000 7f12ee86a700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f12e814e5d0 0x7f12e80bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:12.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.114+0000 7f12ee86a700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e80bf3d0 con 0x7f12e80b9f90 2020-11-20T12:14:12.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.114+0000 7f12ee86a700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80bad90 con 0x7f12e80bfb50 2020-11-20T12:14:12.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.114+0000 7f12ee86a700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e814da00 con 0x7f12e814e5d0 2020-11-20T12:14:12.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.115+0000 7f12ee069700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f12e80b9f90 0x7f12e80bd890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46568/0 (socket says 172.21.15.160:46568) 2020-11-20T12:14:12.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.115+0000 7f12ee069700 1 -- 172.21.15.160:0/1058305305 learned_addr learned my addr 172.21.15.160:0/1058305305 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:12.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.115+0000 7f12ed868700 1 --2- 172.21.15.160:0/1058305305 >> v2:172.21.15.134:3300/0 conn(0x7f12e80bfb50 0x7f12e80bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.115+0000 7f12ed067700 1 --2- 172.21.15.160:0/1058305305 >> v2:172.21.15.150:3300/0 conn(0x7f12e814e5d0 0x7f12e80bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.115+0000 7f12ec866700 1 -- 172.21.15.160:0/1058305305 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028030343 0 0) 0x7f12e80bf3d0 con 0x7f12e80b9f90 2020-11-20T12:14:12.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.115+0000 7f12ec866700 1 -- 172.21.15.160:0/1058305305 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12d0003240 con 0x7f12e80b9f90 2020-11-20T12:14:12.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ed067700 1 -- 172.21.15.160:0/1058305305 >> v2:172.21.15.134:3300/0 conn(0x7f12e80bfb50 msgr2=0x7f12e80bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:12.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ed067700 1 --2- 172.21.15.160:0/1058305305 >> v2:172.21.15.134:3300/0 conn(0x7f12e80bfb50 0x7f12e80bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:12.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ed067700 1 -- 172.21.15.160:0/1058305305 >> v1:172.21.15.150:6789/0 conn(0x7f12e80b9f90 legacy=0x7f12e80bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:12.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ed067700 1 -- 172.21.15.160:0/1058305305 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e80ba850 con 0x7f12e814e5d0 2020-11-20T12:14:12.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ed868700 1 --2- 172.21.15.160:0/1058305305 >> v2:172.21.15.134:3300/0 conn(0x7f12e80bfb50 0x7f12e80bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:12.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ed067700 1 --2- 172.21.15.160:0/1058305305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e814e5d0 0x7f12e80bcd10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f12e80c0420 tx=0x7f12d8006e80).ready entity=mon.1 client_cookie=9f65d40aaef35b3a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:12.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ec866700 1 -- 172.21.15.160:0/1058305305 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d800bb50 con 0x7f12e814e5d0 2020-11-20T12:14:12.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ec866700 1 -- 172.21.15.160:0/1058305305 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d800bcb0 con 0x7f12e814e5d0 2020-11-20T12:14:12.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.116+0000 7f12ec866700 1 -- 172.21.15.160:0/1058305305 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8010680 con 0x7f12e814e5d0 2020-11-20T12:14:12.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 -- 172.21.15.160:0/1058305305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e814e5d0 msgr2=0x7f12e80bcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:12.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 --2- 172.21.15.160:0/1058305305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e814e5d0 0x7f12e80bcd10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f12e80c0420 tx=0x7f12d8006e80).stop 2020-11-20T12:14:12.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 -- 172.21.15.160:0/1058305305 shutdown_connections 2020-11-20T12:14:12.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 --2- 172.21.15.160:0/1058305305 >> v2:172.21.15.134:3300/0 conn(0x7f12e80bfb50 0x7f12e80bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:12.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 --2- 172.21.15.160:0/1058305305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e814e5d0 0x7f12e80bcd10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:12.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 -- 172.21.15.160:0/1058305305 >> 172.21.15.160:0/1058305305 conn(0x7f12e8060140 msgr2=0x7f12e8060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:12.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 -- 172.21.15.160:0/1058305305 shutdown_connections 2020-11-20T12:14:12.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.117+0000 7f12ee86a700 1 -- 172.21.15.160:0/1058305305 wait complete. 2020-11-20T12:14:12.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.118+0000 7f12ee86a700 1 Processor -- start 2020-11-20T12:14:12.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.119+0000 7f12ee86a700 1 -- start start 2020-11-20T12:14:12.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.119+0000 7f12ee86a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80b9f90 0x7f12e8153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:12.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.119+0000 7f12ee86a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12e80bfb50 0x7f12e8064bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:12.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.119+0000 7f12ee86a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e814e5d0 0x7f12e8152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:12.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.119+0000 7f12ee86a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80bca00 con 0x7f12e814e5d0 2020-11-20T12:14:12.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ee86a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8150510 con 0x7f12e80b9f90 2020-11-20T12:14:12.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ee86a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e81542e0 con 0x7f12e80bfb50 2020-11-20T12:14:12.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12e80bfb50 0x7f12e8064bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12e80bfb50 0x7f12e8064bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37730/0 (socket says 172.21.15.160:37730) 2020-11-20T12:14:12.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 -- 172.21.15.160:0/2189696676 learned_addr learned my addr 172.21.15.160:0/2189696676 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:12.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ee069700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e814e5d0 0x7f12e8152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed868700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80b9f90 0x7f12e8153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 -- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80b9f90 msgr2=0x7f12e8153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:12.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80b9f90 0x7f12e8153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:12.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 -- 172.21.15.160:0/2189696676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e814e5d0 msgr2=0x7f12e8152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:12.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e814e5d0 0x7f12e8152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:12.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 -- 172.21.15.160:0/2189696676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8150770 con 0x7f12e80bfb50 2020-11-20T12:14:12.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ee069700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e814e5d0 0x7f12e8152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:12.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.120+0000 7f12ed067700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12e80bfb50 0x7f12e8064bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f12d8006ec0 tx=0x7f12e80ba9e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:12.131 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.121+0000 7f12d5ffb700 1 -- 172.21.15.160:0/2189696676 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d801a600 con 0x7f12e80bfb50 2020-11-20T12:14:12.131 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.121+0000 7f12d5ffb700 1 -- 172.21.15.160:0/2189696676 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d801a760 con 0x7f12e80bfb50 2020-11-20T12:14:12.131 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.121+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e8150a10 con 0x7f12e80bfb50 2020-11-20T12:14:12.131 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.121+0000 7f12d5ffb700 1 -- 172.21.15.160:0/2189696676 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d801aae0 con 0x7f12e80bfb50 2020-11-20T12:14:12.131 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.121+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e8150f50 con 0x7f12e80bfb50 2020-11-20T12:14:12.132 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.122+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e8154030 con 0x7f12e80bfb50 2020-11-20T12:14:12.132 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.123+0000 7f12d5ffb700 1 -- 172.21.15.160:0/2189696676 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f12d8018400 con 0x7f12e80bfb50 2020-11-20T12:14:12.133 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.124+0000 7f12d5ffb700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f12c0080630 0x7f12c0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:12.133 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.125+0000 7f12d5ffb700 1 -- 172.21.15.160:0/2189696676 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f12d80a3ba0 con 0x7f12e80bfb50 2020-11-20T12:14:12.133 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.125+0000 7f12ed868700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f12c0080630 0x7f12c0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.133 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.125+0000 7f12ed868700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f12c0080630 0x7f12c0082af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f12e4006fd0 tx=0x7f12e4006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:12.134 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.128+0000 7f12d5ffb700 1 -- 172.21.15.160:0/2189696676 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f12d8078740 con 0x7f12e80bfb50 2020-11-20T12:14:12.314 INFO:tasks.ceph.mds.a.smithi160.stderr:2020-11-20T12:14:12.310+0000 7f169eb13700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-11-20T12:14:12.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:12.380+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12e8044f60 con 0x7f12e80bfb50 2020-11-20T12:14:13.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.344+0000 7f12d5ffb700 1 -- 172.21.15.160:0/2189696676 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f12d807bd60 con 0x7f12e80bfb50 2020-11-20T12:14:13.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f12c0080630 msgr2=0x7f12c0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f12c0080630 0x7f12c0082af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f12e4006fd0 tx=0x7f12e4006df0).stop 2020-11-20T12:14:13.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12e80bfb50 msgr2=0x7f12e8064bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12e80bfb50 0x7f12e8064bf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f12d8006ec0 tx=0x7f12e80ba9e0).stop 2020-11-20T12:14:13.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 shutdown_connections 2020-11-20T12:14:13.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f12c0080630 0x7f12c0082af0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12e814e5d0 0x7f12e8152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f12e80b9f90 0x7f12e8153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 --2- 172.21.15.160:0/2189696676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12e80bfb50 0x7f12e8064bf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.347+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 >> 172.21.15.160:0/2189696676 conn(0x7f12e8060140 msgr2=0x7f12e8065830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:13.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.348+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 shutdown_connections 2020-11-20T12:14:13.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.348+0000 7f12ee86a700 1 -- 172.21.15.160:0/2189696676 wait complete. 2020-11-20T12:14:13.378 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2020-11-20T12:14:13.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.655+0000 7f6f6884e700 1 Processor -- start 2020-11-20T12:14:13.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.655+0000 7f6f6884e700 1 -- start start 2020-11-20T12:14:13.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f6884e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6f640bff30 0x7f6f640bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:13.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f6884e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f640bf3d0 con 0x7f6f6414e5d0 2020-11-20T12:14:13.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f6884e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f640ba850 con 0x7f6f640bfb50 2020-11-20T12:14:13.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f6884e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f640bad90 con 0x7f6f640bff30 2020-11-20T12:14:13.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f63fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6f640bff30 0x7f6f640bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:13.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f62ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6f6414e5d0 0x7f6f640b9f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46582/0 (socket says 172.21.15.160:46582) 2020-11-20T12:14:13.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f63fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6f640bff30 0x7f6f640bd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37742/0 (socket says 172.21.15.160:37742) 2020-11-20T12:14:13.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.657+0000 7f6f62ffd700 1 -- 172.21.15.160:0/2184905014 learned_addr learned my addr 172.21.15.160:0/2184905014 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:13.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.658+0000 7f6f627fc700 1 -- 172.21.15.160:0/2184905014 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679912162 0 0) 0x7f6f640bf3d0 con 0x7f6f6414e5d0 2020-11-20T12:14:13.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.658+0000 7f6f627fc700 1 -- 172.21.15.160:0/2184905014 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f50003240 con 0x7f6f6414e5d0 2020-11-20T12:14:13.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.658+0000 7f6f63fff700 1 -- 172.21.15.160:0/2184905014 >> v1:172.21.15.160:6789/0 conn(0x7f6f640bfb50 legacy=0x7f6f640bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.658+0000 7f6f63fff700 1 -- 172.21.15.160:0/2184905014 >> v1:172.21.15.150:6789/0 conn(0x7f6f6414e5d0 legacy=0x7f6f640b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.658+0000 7f6f63fff700 1 -- 172.21.15.160:0/2184905014 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640baaf0 con 0x7f6f640bff30 2020-11-20T12:14:13.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.658+0000 7f6f63fff700 1 --2- 172.21.15.160:0/2184905014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f640bd890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6f5c00bf30 tx=0x7f6f5c00b470).ready entity=mon.2 client_cookie=a98b28a7b80a3204 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:13.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.659+0000 7f6f627fc700 1 -- 172.21.15.160:0/2184905014 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c010470 con 0x7f6f640bff30 2020-11-20T12:14:13.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.659+0000 7f6f627fc700 1 -- 172.21.15.160:0/2184905014 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0105d0 con 0x7f6f640bff30 2020-11-20T12:14:13.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.659+0000 7f6f627fc700 1 -- 172.21.15.160:0/2184905014 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c010950 con 0x7f6f640bff30 2020-11-20T12:14:13.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.659+0000 7f6f6884e700 1 -- 172.21.15.160:0/2184905014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 msgr2=0x7f6f640bd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.659+0000 7f6f6884e700 1 --2- 172.21.15.160:0/2184905014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f640bd890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6f5c00bf30 tx=0x7f6f5c00b470).stop 2020-11-20T12:14:13.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.660+0000 7f6f6884e700 1 -- 172.21.15.160:0/2184905014 shutdown_connections 2020-11-20T12:14:13.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.660+0000 7f6f6884e700 1 --2- 172.21.15.160:0/2184905014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f640bd890 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.660+0000 7f6f6884e700 1 -- 172.21.15.160:0/2184905014 >> 172.21.15.160:0/2184905014 conn(0x7f6f64060140 msgr2=0x7f6f64060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:13.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.660+0000 7f6f6884e700 1 -- 172.21.15.160:0/2184905014 shutdown_connections 2020-11-20T12:14:13.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.660+0000 7f6f6884e700 1 -- 172.21.15.160:0/2184905014 wait complete. 2020-11-20T12:14:13.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.662+0000 7f6f6884e700 1 Processor -- start 2020-11-20T12:14:13.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.662+0000 7f6f6884e700 1 -- start start 2020-11-20T12:14:13.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.663+0000 7f6f6884e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f640bfb50 0x7f6f6415c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:13.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.663+0000 7f6f6884e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f64141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:13.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.663+0000 7f6f6884e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f6414e5d0 0x7f6f64152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:13.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.663+0000 7f6f6884e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6415cc20 con 0x7f6f6414e5d0 2020-11-20T12:14:13.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.663+0000 7f6f6884e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f641520a0 con 0x7f6f640bfb50 2020-11-20T12:14:13.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.663+0000 7f6f6884e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6414bef0 con 0x7f6f640bff30 2020-11-20T12:14:13.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f637fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f640bfb50 0x7f6f6415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:13.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f62ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f64141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:13.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f637fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f640bfb50 0x7f6f6415c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:50880/0 (socket says 172.21.15.160:50880) 2020-11-20T12:14:13.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f637fe700 1 -- 172.21.15.160:0/1101573992 learned_addr learned my addr 172.21.15.160:0/1101573992 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:13.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f63fff700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f6414e5d0 0x7f6f64152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:13.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f62ffd700 1 -- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f640bfb50 msgr2=0x7f6f6415c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f62ffd700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f640bfb50 0x7f6f6415c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f62ffd700 1 -- 172.21.15.160:0/1101573992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f6414e5d0 msgr2=0x7f6f64152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f62ffd700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f6414e5d0 0x7f6f64152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f62ffd700 1 -- 172.21.15.160:0/1101573992 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6414c190 con 0x7f6f640bff30 2020-11-20T12:14:13.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.664+0000 7f6f62ffd700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f64141640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6f5800c710 tx=0x7f6f580079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:13.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.665+0000 7f6f437fe700 1 -- 172.21.15.160:0/1101573992 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f580072e0 con 0x7f6f640bff30 2020-11-20T12:14:13.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.665+0000 7f6f437fe700 1 -- 172.21.15.160:0/1101573992 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58007460 con 0x7f6f640bff30 2020-11-20T12:14:13.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.665+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f641522d0 con 0x7f6f640bff30 2020-11-20T12:14:13.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.665+0000 7f6f437fe700 1 -- 172.21.15.160:0/1101573992 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58005840 con 0x7f6f640bff30 2020-11-20T12:14:13.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.665+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f64152810 con 0x7f6f640bff30 2020-11-20T12:14:13.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.666+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f641529d0 con 0x7f6f640bff30 2020-11-20T12:14:13.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.667+0000 7f6f437fe700 1 -- 172.21.15.160:0/1101573992 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6f58010070 con 0x7f6f640bff30 2020-11-20T12:14:13.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.669+0000 7f6f437fe700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6f3c080630 0x7f6f3c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:13.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.669+0000 7f6f437fe700 1 -- 172.21.15.160:0/1101573992 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f6f580a1d80 con 0x7f6f640bff30 2020-11-20T12:14:13.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.669+0000 7f6f637fe700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6f3c080630 0x7f6f3c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:13.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.670+0000 7f6f637fe700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6f3c080630 0x7f6f3c082af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6f540036e0 tx=0x7f6f54000b80).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:13.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.672+0000 7f6f437fe700 1 -- 172.21.15.160:0/1101573992 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6f58076870 con 0x7f6f640bff30 2020-11-20T12:14:13.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:13.922+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f6f64044f60 con 0x7f6f640bff30 2020-11-20T12:14:14.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.354+0000 7f6f437fe700 1 -- 172.21.15.160:0/1101573992 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6f58007b20 con 0x7f6f640bff30 2020-11-20T12:14:14.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6f3c080630 msgr2=0x7f6f3c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:14.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6f3c080630 0x7f6f3c082af0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f6f540036e0 tx=0x7f6f54000b80).stop 2020-11-20T12:14:14.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 msgr2=0x7f6f64141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:14.817 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f64141640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6f5800c710 tx=0x7f6f580079e0).stop 2020-11-20T12:14:14.817 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 shutdown_connections 2020-11-20T12:14:14.817 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6f3c080630 0x7f6f3c082af0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:14.818 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f6414e5d0 0x7f6f64152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:14.818 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6f640bfb50 0x7f6f6415c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:14.819 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 --2- 172.21.15.160:0/1101573992 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f640bff30 0x7f6f64141640 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:14.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.357+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 >> 172.21.15.160:0/1101573992 conn(0x7f6f64060140 msgr2=0x7f6f640c0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:14.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.358+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 shutdown_connections 2020-11-20T12:14:14.825 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:14.358+0000 7f6f6884e700 1 -- 172.21.15.160:0/1101573992 wait complete. 2020-11-20T12:14:14.826 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T12:14:15.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.081+0000 7f3ab10d1700 1 Processor -- start 2020-11-20T12:14:15.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.081+0000 7f3ab10d1700 1 -- start start 2020-11-20T12:14:15.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3ab10d1700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3aac061870 0x7f3aac061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3ab10d1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3aac063a10 0x7f3aac0bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3ab10d1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3aac0bdda0 0x7f3aac14f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3ab10d1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac0bf640 con 0x7f3aac0bdda0 2020-11-20T12:14:15.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3ab10d1700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac064e00 con 0x7f3aac061870 2020-11-20T12:14:15.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3ab10d1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac0bca40 con 0x7f3aac063a10 2020-11-20T12:14:15.090 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3aab7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3aac063a10 0x7f3aac0bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.090 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3aabfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3aac061870 0x7f3aac061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.090 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3aab7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3aac063a10 0x7f3aac0bd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37756/0 (socket says 172.21.15.160:37756) 2020-11-20T12:14:15.091 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3aab7fe700 1 -- 172.21.15.160:0/761426082 learned_addr learned my addr 172.21.15.160:0/761426082 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:15.091 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3aabfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3aac061870 0x7f3aac061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:50888/0 (socket says 172.21.15.160:50888) 2020-11-20T12:14:15.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.083+0000 7f3ab08d0700 1 --2- 172.21.15.160:0/761426082 >> v2:172.21.15.134:3300/0 conn(0x7f3aac0bdda0 0x7f3aac14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aab7fe700 1 -- 172.21.15.160:0/761426082 >> v2:172.21.15.150:3300/0 conn(0x7f3aac061870 msgr2=0x7f3aac061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:15.102 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aab7fe700 1 --2- 172.21.15.160:0/761426082 >> v2:172.21.15.150:3300/0 conn(0x7f3aac061870 0x7f3aac061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.102 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aab7fe700 1 -- 172.21.15.160:0/761426082 >> v2:172.21.15.134:3300/0 conn(0x7f3aac0bdda0 msgr2=0x7f3aac14f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:15.103 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aab7fe700 1 --2- 172.21.15.160:0/761426082 >> v2:172.21.15.134:3300/0 conn(0x7f3aac0bdda0 0x7f3aac14f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.103 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aab7fe700 1 -- 172.21.15.160:0/761426082 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0bcce0 con 0x7f3aac063a10 2020-11-20T12:14:15.104 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aab7fe700 1 --2- 172.21.15.160:0/761426082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac0bd8b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3aac05c2a0 tx=0x7f3aa0006eb0).ready entity=mon.2 client_cookie=1496d2af2168ca5b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.104 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aaaffd700 1 -- 172.21.15.160:0/761426082 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00097b0 con 0x7f3aac063a10 2020-11-20T12:14:15.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aaaffd700 1 -- 172.21.15.160:0/761426082 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0009910 con 0x7f3aac063a10 2020-11-20T12:14:15.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.084+0000 7f3aaaffd700 1 -- 172.21.15.160:0/761426082 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0009c90 con 0x7f3aac063a10 2020-11-20T12:14:15.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 -- 172.21.15.160:0/761426082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 msgr2=0x7f3aac0bd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/761426082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac0bd8b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3aac05c2a0 tx=0x7f3aa0006eb0).stop 2020-11-20T12:14:15.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 -- 172.21.15.160:0/761426082 shutdown_connections 2020-11-20T12:14:15.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/761426082 >> v2:172.21.15.134:3300/0 conn(0x7f3aac0bdda0 0x7f3aac14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/761426082 >> v2:172.21.15.150:3300/0 conn(0x7f3aac061870 0x7f3aac061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/761426082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac0bd8b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 -- 172.21.15.160:0/761426082 >> 172.21.15.160:0/761426082 conn(0x7f3aac062ef0 msgr2=0x7f3aac063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:15.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 -- 172.21.15.160:0/761426082 shutdown_connections 2020-11-20T12:14:15.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.085+0000 7f3ab10d1700 1 -- 172.21.15.160:0/761426082 wait complete. 2020-11-20T12:14:15.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.087+0000 7f3ab10d1700 1 Processor -- start 2020-11-20T12:14:15.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.087+0000 7f3ab10d1700 1 -- start start 2020-11-20T12:14:15.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.088+0000 7f3ab10d1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aac061870 0x7f3aac0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.088+0000 7f3ab10d1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.088+0000 7f3ab10d1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aac0bdda0 0x7f3aac0c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.088+0000 7f3ab10d1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0c3e10 con 0x7f3aac061870 2020-11-20T12:14:15.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.088+0000 7f3ab10d1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac161830 con 0x7f3aac0bdda0 2020-11-20T12:14:15.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.088+0000 7f3ab10d1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac161a90 con 0x7f3aac063a10 2020-11-20T12:14:15.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aab7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.119 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aabfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aac061870 0x7f3aac0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aabfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aac061870 0x7f3aac0c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60280/0 (socket says 172.21.15.160:60280) 2020-11-20T12:14:15.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aabfff700 1 -- 172.21.15.160:0/3186178242 learned_addr learned my addr 172.21.15.160:0/3186178242 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:15.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3ab08d0700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aac0bdda0 0x7f3aac0c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aab7fe700 1 -- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aac0bdda0 msgr2=0x7f3aac0c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aab7fe700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aac0bdda0 0x7f3aac0c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aab7fe700 1 -- 172.21.15.160:0/3186178242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aac061870 msgr2=0x7f3aac0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aab7fe700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aac061870 0x7f3aac0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aab7fe700 1 -- 172.21.15.160:0/3186178242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac161d30 con 0x7f3aac063a10 2020-11-20T12:14:15.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.089+0000 7f3aab7fe700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac152300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3aa0010000 tx=0x7f3aa0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.090+0000 7f3a8bfff700 1 -- 172.21.15.160:0/3186178242 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0011c80 con 0x7f3aac063a10 2020-11-20T12:14:15.125 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.090+0000 7f3a8bfff700 1 -- 172.21.15.160:0/3186178242 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0011de0 con 0x7f3aac063a10 2020-11-20T12:14:15.125 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.090+0000 7f3a8bfff700 1 -- 172.21.15.160:0/3186178242 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa001e670 con 0x7f3aac063a10 2020-11-20T12:14:15.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.090+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac161fd0 con 0x7f3aac063a10 2020-11-20T12:14:15.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.090+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac0c3320 con 0x7f3aac063a10 2020-11-20T12:14:15.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.091+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac162430 con 0x7f3aac063a10 2020-11-20T12:14:15.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.092+0000 7f3a8bfff700 1 -- 172.21.15.160:0/3186178242 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3aa001a040 con 0x7f3aac063a10 2020-11-20T12:14:15.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.093+0000 7f3a8bfff700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3a84080630 0x7f3a84082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.093+0000 7f3a8bfff700 1 -- 172.21.15.160:0/3186178242 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f3aa00a3a80 con 0x7f3aac063a10 2020-11-20T12:14:15.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.093+0000 7f3aabfff700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3a84080630 0x7f3a84082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.094+0000 7f3aabfff700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3a84080630 0x7f3a84082af0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3a9c006a90 tx=0x7f3a9c006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.097+0000 7f3a8bfff700 1 -- 172.21.15.160:0/3186178242 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3aa0078600 con 0x7f3aac063a10 2020-11-20T12:14:15.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.344+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3aac044f60 con 0x7f3aac063a10 2020-11-20T12:14:15.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.345+0000 7f3a8bfff700 1 -- 172.21.15.160:0/3186178242 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f3aa0023030 con 0x7f3aac063a10 2020-11-20T12:14:15.348 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:15.349 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/70698057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":70698057},{"type":"v1","addr":"172.21.15.150:6835","nonce":70698057}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4305,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1085571547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1085571547},{"type":"v1","addr":"172.21.15.134:6833","nonce":1085571547}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T12:14:10.878025+0000","modified":"2020-11-20T12:14:14.341505+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6833/2973718049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2973718049},{"type":"v1","addr":"172.21.15.160:6833","nonce":2973718049}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T12:14:15.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3a84080630 msgr2=0x7f3a84082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3a84080630 0x7f3a84082af0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3a9c006a90 tx=0x7f3a9c006df0).stop 2020-11-20T12:14:15.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 msgr2=0x7f3aac152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac152300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3aa0010000 tx=0x7f3aa0015000).stop 2020-11-20T12:14:15.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 shutdown_connections 2020-11-20T12:14:15.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3a84080630 0x7f3a84082af0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3aac0bdda0 0x7f3aac0c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3aac061870 0x7f3aac0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 --2- 172.21.15.160:0/3186178242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3aac063a10 0x7f3aac152300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 >> 172.21.15.160:0/3186178242 conn(0x7f3aac062ef0 msgr2=0x7f3aac149030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:15.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 shutdown_connections 2020-11-20T12:14:15.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.347+0000 7f3ab10d1700 1 -- 172.21.15.160:0/3186178242 wait complete. 2020-11-20T12:14:15.353 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 8 2020-11-20T12:14:15.378 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:15.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.626+0000 7f49b1c3e700 1 Processor -- start 2020-11-20T12:14:15.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.626+0000 7f49b1c3e700 1 -- start start 2020-11-20T12:14:15.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49b1c3e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49ac0ba320 0x7f49ac0bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49b1c3e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f49ac0ba700 0x7f49ac14ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49b1c3e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0c3510 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49b1c3e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac14e0e0 con 0x7f49ac0ba700 2020-11-20T12:14:15.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49b1c3e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac0c37b0 con 0x7f49ac0ba320 2020-11-20T12:14:15.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49ab7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f49ac0ba320 0x7f49ac0bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.639 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49a2ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f49ac0c2fd0 0x7f49ac14d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46612/0 (socket says 172.21.15.160:46612) 2020-11-20T12:14:15.639 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49a2ffd700 1 -- 172.21.15.160:0/2332579029 learned_addr learned my addr 172.21.15.160:0/2332579029 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:15.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.628+0000 7f49abfff700 1 --2- 172.21.15.160:0/2332579029 >> v2:172.21.15.134:3300/0 conn(0x7f49ac0ba700 0x7f49ac14ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49ab7fe700 1 -- 172.21.15.160:0/2332579029 >> v2:172.21.15.134:3300/0 conn(0x7f49ac0ba700 msgr2=0x7f49ac14ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:15.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49ab7fe700 1 --2- 172.21.15.160:0/2332579029 >> v2:172.21.15.134:3300/0 conn(0x7f49ac0ba700 0x7f49ac14ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49ab7fe700 1 -- 172.21.15.160:0/2332579029 >> v1:172.21.15.150:6789/0 conn(0x7f49ac0c2fd0 legacy=0x7f49ac14d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49ab7fe700 1 -- 172.21.15.160:0/2332579029 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0c3a50 con 0x7f49ac0ba320 2020-11-20T12:14:15.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49aaffd700 1 -- 172.21.15.160:0/2332579029 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206785777 0 0) 0x7f49ac0c3510 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49ab7fe700 1 --2- 172.21.15.160:0/2332579029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 0x7f49ac0bece0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f499c00b9a0 tx=0x7f499c006df0).ready entity=mon.1 client_cookie=42c1ba7c6e6fad9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49aaffd700 1 -- 172.21.15.160:0/2332579029 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c009770 con 0x7f49ac0ba320 2020-11-20T12:14:15.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49aaffd700 1 -- 172.21.15.160:0/2332579029 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499c0098d0 con 0x7f49ac0ba320 2020-11-20T12:14:15.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.629+0000 7f49aaffd700 1 -- 172.21.15.160:0/2332579029 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499c009c50 con 0x7f49ac0ba320 2020-11-20T12:14:15.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2332579029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 msgr2=0x7f49ac0bece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2332579029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 0x7f49ac0bece0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f499c00b9a0 tx=0x7f499c006df0).stop 2020-11-20T12:14:15.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2332579029 shutdown_connections 2020-11-20T12:14:15.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2332579029 >> v2:172.21.15.134:3300/0 conn(0x7f49ac0ba700 0x7f49ac14ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2332579029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 0x7f49ac0bece0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2332579029 >> 172.21.15.160:0/2332579029 conn(0x7f49ac068150 msgr2=0x7f49ac060140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:15.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2332579029 shutdown_connections 2020-11-20T12:14:15.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.630+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2332579029 wait complete. 2020-11-20T12:14:15.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.631+0000 7f49b1c3e700 1 Processor -- start 2020-11-20T12:14:15.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.632+0000 7f49b1c3e700 1 -- start start 2020-11-20T12:14:15.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.632+0000 7f49b1c3e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 0x7f49ac0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.632+0000 7f49b1c3e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0ba700 0x7f49ac14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.632+0000 7f49b1c3e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c2fd0 0x7f49ac14da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.632+0000 7f49b1c3e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac15bfb0 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.632+0000 7f49b1c3e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac15c250 con 0x7f49ac0ba320 2020-11-20T12:14:15.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.632+0000 7f49b1c3e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac15c4f0 con 0x7f49ac0ba700 2020-11-20T12:14:15.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49a2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0ba700 0x7f49ac14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49ab7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 0x7f49ac0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c2fd0 0x7f49ac14da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c2fd0 0x7f49ac14da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60298/0 (socket says 172.21.15.160:60298) 2020-11-20T12:14:15.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 -- 172.21.15.160:0/2425124798 learned_addr learned my addr 172.21.15.160:0/2425124798 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:15.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 -- 172.21.15.160:0/2425124798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0ba700 msgr2=0x7f49ac14d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0ba700 0x7f49ac14d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 -- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 msgr2=0x7f49ac0c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 0x7f49ac0c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.633+0000 7f49abfff700 1 -- 172.21.15.160:0/2425124798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac15c790 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.634+0000 7f49abfff700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c2fd0 0x7f49ac14da40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f49a400ef50 tx=0x7f49a40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.634+0000 7f49a3fff700 1 -- 172.21.15.160:0/2425124798 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a400cbd0 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.634+0000 7f49a3fff700 1 -- 172.21.15.160:0/2425124798 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a400cd30 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.634+0000 7f49a3fff700 1 -- 172.21.15.160:0/2425124798 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4012620 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.634+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac15ca30 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.634+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac0c29f0 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.635+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac0be0a0 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.637+0000 7f49a3fff700 1 -- 172.21.15.160:0/2425124798 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f49a4022070 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.638+0000 7f49a3fff700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4988080630 0x7f4988082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.638+0000 7f49a3fff700 1 -- 172.21.15.160:0/2425124798 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f49a40a31b0 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.638+0000 7f49ab7fe700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4988080630 0x7f4988082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.663 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.639+0000 7f49ab7fe700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4988080630 0x7f4988082af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f499c00b150 tx=0x7f499c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.663 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.641+0000 7f49a3fff700 1 -- 172.21.15.160:0/2425124798 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f49a4077db0 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.813+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49ac0694d0 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.815+0000 7f49a3fff700 1 -- 172.21.15.160:0/2425124798 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7f49a4016020 con 0x7f49ac0c2fd0 2020-11-20T12:14:15.821 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:15.822 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:15.824 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.816+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4988080630 msgr2=0x7f4988082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.825 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.816+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4988080630 0x7f4988082af0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f499c00b150 tx=0x7f499c015000).stop 2020-11-20T12:14:15.825 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c2fd0 msgr2=0x7f49ac14da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.825 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c2fd0 0x7f49ac14da40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f49a400ef50 tx=0x7f49a40091d0).stop 2020-11-20T12:14:15.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 shutdown_connections 2020-11-20T12:14:15.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4988080630 0x7f4988082af0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49ac0c2fd0 0x7f49ac14da40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49ac0ba320 0x7f49ac0c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 --2- 172.21.15.160:0/2425124798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ac0ba700 0x7f49ac14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 >> 172.21.15.160:0/2425124798 conn(0x7f49ac068150 msgr2=0x7f49ac0bcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:15.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 shutdown_connections 2020-11-20T12:14:15.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:15.817+0000 7f49b1c3e700 1 -- 172.21.15.160:0/2425124798 wait complete. 2020-11-20T12:14:15.841 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:15.842 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T12:14:16.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.068+0000 7fe0bf59e700 1 Processor -- start 2020-11-20T12:14:16.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.069+0000 7fe0bf59e700 1 -- start start 2020-11-20T12:14:16.075 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.071+0000 7fe0bf59e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe0c00bbaf0 0x7fe0c00653a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.075 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.071+0000 7fe0bf59e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00624d0 con 0x7fe0c0151500 2020-11-20T12:14:16.075 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.071+0000 7fe0bf59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00bc060 con 0x7fe0c0064fc0 2020-11-20T12:14:16.075 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.071+0000 7fe0bf59e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c00bc300 con 0x7fe0c00bbaf0 2020-11-20T12:14:16.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0be59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe0c0064fc0 0x7fe0c00616b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46624/0 (socket says 172.21.15.160:46624) 2020-11-20T12:14:16.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0b5d9b700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fe0c0151500 0x7fe0c0061dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60088/0 (socket says 172.21.15.160:60088) 2020-11-20T12:14:16.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0be59c700 1 -- 172.21.15.160:0/882571897 learned_addr learned my addr 172.21.15.160:0/882571897 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:16.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0bed9d700 1 --2- 172.21.15.160:0/882571897 >> v2:172.21.15.134:3300/0 conn(0x7fe0c00bbaf0 0x7fe0c00653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907369230 0 0) 0x7fe0c00624d0 con 0x7fe0c0151500 2020-11-20T12:14:16.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a0003240 con 0x7fe0c0151500 2020-11-20T12:14:16.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758563961 0 0) 0x7fe0c00bc060 con 0x7fe0c0064fc0 2020-11-20T12:14:16.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.072+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c00624d0 con 0x7fe0c0064fc0 2020-11-20T12:14:16.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2195378433 0 0) 0x7fe0a0003240 con 0x7fe0c0151500 2020-11-20T12:14:16.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 >> v2:172.21.15.134:3300/0 conn(0x7fe0c00bbaf0 msgr2=0x7fe0c00653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:16.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 --2- 172.21.15.160:0/882571897 >> v2:172.21.15.134:3300/0 conn(0x7fe0c00bbaf0 0x7fe0c00653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 >> v1:172.21.15.150:6789/0 conn(0x7fe0c0064fc0 legacy=0x7fe0c00616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0150880 con 0x7fe0c0151500 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7fe0a80014e0 con 0x7fe0c0151500 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bed9d700 1 --2- 172.21.15.160:0/882571897 >> v2:172.21.15.134:3300/0 conn(0x7fe0c00bbaf0 0x7fe0c00653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 >> v1:172.21.15.134:6789/0 conn(0x7fe0c0151500 legacy=0x7fe0c0061dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0a0004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0a0003480 0x7fe0a0003900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a0003df0 0x7fe0a000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00bc300 con 0x7fe0a0004950 2020-11-20T12:14:16.084 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0004350 con 0x7fe0a0003df0 2020-11-20T12:14:16.084 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a000bca0 con 0x7fe0a0003480 2020-11-20T12:14:16.084 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0be59c700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0a0004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.084 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0b5d9b700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0a0003480 0x7fe0a0003900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.073+0000 7fe0bed9d700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a0003df0 0x7fe0a000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0be59c700 1 -- 172.21.15.160:0/882571897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0a0003480 msgr2=0x7fe0a0003900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:16.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0be59c700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0a0003480 0x7fe0a0003900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0be59c700 1 -- 172.21.15.160:0/882571897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a0003df0 msgr2=0x7fe0a000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:16.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0be59c700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a0003df0 0x7fe0a000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.086 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0be59c700 1 -- 172.21.15.160:0/882571897 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0003240 con 0x7fe0a0004950 2020-11-20T12:14:16.086 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0bed9d700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0a0003df0 0x7fe0a000b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:16.086 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0bed9d700 1 -- 172.21.15.160:0/882571897 reap_dead start 2020-11-20T12:14:16.086 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0be59c700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0a0004d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe0b000c190 tx=0x7fe0b0001e30).ready entity=mon.0 client_cookie=4442a11e53b63949 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.086 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0007170 con 0x7fe0a0004950 2020-11-20T12:14:16.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b00072d0 con 0x7fe0a0004950 2020-11-20T12:14:16.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.074+0000 7fe0bdd9b700 1 -- 172.21.15.160:0/882571897 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0004810 con 0x7fe0a0004950 2020-11-20T12:14:16.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.075+0000 7fe0bf59e700 1 -- 172.21.15.160:0/882571897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 msgr2=0x7fe0a0004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.075+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0a0004d30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe0b000c190 tx=0x7fe0b0001e30).stop 2020-11-20T12:14:16.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.075+0000 7fe0bf59e700 1 -- 172.21.15.160:0/882571897 shutdown_connections 2020-11-20T12:14:16.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.075+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/882571897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0a0004d30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.075+0000 7fe0bf59e700 1 -- 172.21.15.160:0/882571897 >> 172.21.15.160:0/882571897 conn(0x7fe0c0062ef0 msgr2=0x7fe0c0063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:16.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.075+0000 7fe0bf59e700 1 -- 172.21.15.160:0/882571897 shutdown_connections 2020-11-20T12:14:16.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.075+0000 7fe0bf59e700 1 -- 172.21.15.160:0/882571897 wait complete. 2020-11-20T12:14:16.091 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.077+0000 7fe0bf59e700 1 Processor -- start 2020-11-20T12:14:16.091 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.077+0000 7fe0bf59e700 1 -- start start 2020-11-20T12:14:16.091 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0bf59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0c013cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0bf59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0c0061a70 0x7fe0c013afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0bf59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0c013b4c0 0x7fe0c0163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0bf59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c013d380 con 0x7fe0a0004950 2020-11-20T12:14:16.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0bf59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c013d960 con 0x7fe0c0061a70 2020-11-20T12:14:16.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0bf59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c013dc00 con 0x7fe0c013b4c0 2020-11-20T12:14:16.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0c013cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0c013cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60314/0 (socket says 172.21.15.160:60314) 2020-11-20T12:14:16.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 -- 172.21.15.160:0/2178605344 learned_addr learned my addr 172.21.15.160:0/2178605344 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:16.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0bed9d700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0c013b4c0 0x7fe0c0163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0b5d9b700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0c0061a70 0x7fe0c013afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 -- 172.21.15.160:0/2178605344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0c013b4c0 msgr2=0x7fe0c0163ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0c013b4c0 0x7fe0c0163ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 -- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0c0061a70 msgr2=0x7fe0c013afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0c0061a70 0x7fe0c013afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.078+0000 7fe0be59c700 1 -- 172.21.15.160:0/2178605344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c013dea0 con 0x7fe0a0004950 2020-11-20T12:14:16.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.079+0000 7fe0be59c700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0c013cac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe0b0000dd0 tx=0x7fe0b0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.079+0000 7fe0b6ffd700 1 -- 172.21.15.160:0/2178605344 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0004dd0 con 0x7fe0a0004950 2020-11-20T12:14:16.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.079+0000 7fe0b6ffd700 1 -- 172.21.15.160:0/2178605344 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0004500 con 0x7fe0a0004950 2020-11-20T12:14:16.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.079+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c013e140 con 0x7fe0a0004950 2020-11-20T12:14:16.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.079+0000 7fe0b6ffd700 1 -- 172.21.15.160:0/2178605344 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0014870 con 0x7fe0a0004950 2020-11-20T12:14:16.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.079+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c0061ef0 con 0x7fe0a0004950 2020-11-20T12:14:16.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.080+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c0044f60 con 0x7fe0a0004950 2020-11-20T12:14:16.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.081+0000 7fe0b6ffd700 1 -- 172.21.15.160:0/2178605344 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe0b0010030 con 0x7fe0a0004950 2020-11-20T12:14:16.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.082+0000 7fe0b6ffd700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe09c080660 0x7fe09c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.082+0000 7fe0b6ffd700 1 -- 172.21.15.160:0/2178605344 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fe0b00a4060 con 0x7fe0a0004950 2020-11-20T12:14:16.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.082+0000 7fe0b5d9b700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe09c080660 0x7fe09c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.083+0000 7fe0b5d9b700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe09c080660 0x7fe09c082b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe0a8000c60 tx=0x7fe0a8007040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.084+0000 7fe0b6ffd700 1 -- 172.21.15.160:0/2178605344 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe0b0078c60 con 0x7fe0a0004950 2020-11-20T12:14:16.273 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.270+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0c0067440 con 0x7fe0a0004950 2020-11-20T12:14:16.275 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.271+0000 7fe0b6ffd700 1 -- 172.21.15.160:0/2178605344 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7fe0b004e460 con 0x7fe0a0004950 2020-11-20T12:14:16.275 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:16.276 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:16.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe09c080660 msgr2=0x7fe09c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe09c080660 0x7fe09c082b20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe0a8000c60 tx=0x7fe0a8007040).stop 2020-11-20T12:14:16.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 msgr2=0x7fe0c013cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0c013cac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe0b0000dd0 tx=0x7fe0b0015000).stop 2020-11-20T12:14:16.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 shutdown_connections 2020-11-20T12:14:16.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe09c080660 0x7fe09c082b20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.279 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0c013b4c0 0x7fe0c0163ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.279 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0a0004950 0x7fe0c013cac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.279 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 --2- 172.21.15.160:0/2178605344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe0c0061a70 0x7fe0c013afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.279 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 >> 172.21.15.160:0/2178605344 conn(0x7fe0c0062ef0 msgr2=0x7fe0c013ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:16.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 shutdown_connections 2020-11-20T12:14:16.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.274+0000 7fe0bf59e700 1 -- 172.21.15.160:0/2178605344 wait complete. 2020-11-20T12:14:16.300 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:13:54.112655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:04.811782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T12:14:08.565233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T12:14:09.890329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T12:14:16.301 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:16.545 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.541+0000 7fc8ee73e700 1 Processor -- start 2020-11-20T12:14:16.545 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.541+0000 7fc8ee73e700 1 -- start start 2020-11-20T12:14:16.546 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.543+0000 7fc8ee73e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc8e80bff30 0x7fc8e80bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.546 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.543+0000 7fc8ee73e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80bf3d0 con 0x7fc8e80bfb50 2020-11-20T12:14:16.547 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.543+0000 7fc8ee73e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80ba850 con 0x7fc8e814e5d0 2020-11-20T12:14:16.547 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.543+0000 7fc8ee73e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80bad90 con 0x7fc8e80bff30 2020-11-20T12:14:16.550 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.543+0000 7fc8ed73c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fc8e80bfb50 0x7fc8e80bcd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46644/0 (socket says 172.21.15.160:46644) 2020-11-20T12:14:16.550 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8ed73c700 1 -- 172.21.15.160:0/2979662475 learned_addr learned my addr 172.21.15.160:0/2979662475 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:16.550 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047312444 0 0) 0x7fc8e80bf3d0 con 0x7fc8e80bfb50 2020-11-20T12:14:16.551 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d0003240 con 0x7fc8e80bfb50 2020-11-20T12:14:16.551 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8edf3d700 1 --2- 172.21.15.160:0/2979662475 >> v2:172.21.15.134:3300/0 conn(0x7fc8e80bff30 0x7fc8e80bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.551 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3569109188 0 0) 0x7fc8d0003240 con 0x7fc8e80bfb50 2020-11-20T12:14:16.551 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 >> v2:172.21.15.134:3300/0 conn(0x7fc8e80bff30 msgr2=0x7fc8e80bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:16.552 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 --2- 172.21.15.160:0/2979662475 >> v2:172.21.15.134:3300/0 conn(0x7fc8e80bff30 0x7fc8e80bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.552 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 >> v1:172.21.15.160:6789/0 conn(0x7fc8e814e5d0 legacy=0x7fc8e80b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.552 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80baaf0 con 0x7fc8e80bfb50 2020-11-20T12:14:16.552 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7fc8e40014e0 con 0x7fc8e80bfb50 2020-11-20T12:14:16.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 >> v1:172.21.15.150:6789/0 conn(0x7fc8e80bfb50 legacy=0x7fc8e80bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.544+0000 7fc8d7fff700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8d0003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8d7fff700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8d00044e0 0x7fc8d0004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8d7fff700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d0004e50 0x7fc8d000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.553 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0004220 con 0x7fc8d0003730 2020-11-20T12:14:16.554 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d000bc20 con 0x7fc8d0004e50 2020-11-20T12:14:16.554 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d000df70 con 0x7fc8d00044e0 2020-11-20T12:14:16.554 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8ed73c700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8d0003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.554 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8ecf3b700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8d00044e0 0x7fc8d0004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8edf3d700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d0004e50 0x7fc8d000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8ed73c700 1 -- 172.21.15.160:0/2979662475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8d00044e0 msgr2=0x7fc8d0004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:16.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8ed73c700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8d00044e0 0x7fc8d0004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.555 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8ed73c700 1 -- 172.21.15.160:0/2979662475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d0004e50 msgr2=0x7fc8d000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:16.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8ed73c700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8d0004e50 0x7fc8d000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8ed73c700 1 -- 172.21.15.160:0/2979662475 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0003240 con 0x7fc8d0003730 2020-11-20T12:14:16.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.545+0000 7fc8edf3d700 1 -- 172.21.15.160:0/2979662475 reap_dead start 2020-11-20T12:14:16.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8ed73c700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8d0003b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc8e400c440 tx=0x7fc8e80ba9e0).ready entity=mon.0 client_cookie=8939a5432a3d66ab server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400ce00 con 0x7fc8d0003730 2020-11-20T12:14:16.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e40072e0 con 0x7fc8d0003730 2020-11-20T12:14:16.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8d7fff700 1 -- 172.21.15.160:0/2979662475 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4005820 con 0x7fc8d0003730 2020-11-20T12:14:16.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2979662475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 msgr2=0x7fc8d0003b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8d0003b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc8e400c440 tx=0x7fc8e80ba9e0).stop 2020-11-20T12:14:16.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2979662475 shutdown_connections 2020-11-20T12:14:16.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2979662475 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8d0003b10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.546+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2979662475 >> 172.21.15.160:0/2979662475 conn(0x7fc8e8060140 msgr2=0x7fc8e8060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:16.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.547+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2979662475 shutdown_connections 2020-11-20T12:14:16.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.547+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2979662475 wait complete. 2020-11-20T12:14:16.561 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.548+0000 7fc8ee73e700 1 Processor -- start 2020-11-20T12:14:16.562 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.548+0000 7fc8ee73e700 1 -- start start 2020-11-20T12:14:16.562 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.549+0000 7fc8ee73e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8e81467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.562 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.549+0000 7fc8ee73e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8e8146cb0 0x7fc8e8163c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.562 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.549+0000 7fc8ee73e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e8164110 0x7fc8e8143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.562 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.549+0000 7fc8ee73e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8148f70 con 0x7fc8d0003730 2020-11-20T12:14:16.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.549+0000 7fc8ee73e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8149210 con 0x7fc8e8164110 2020-11-20T12:14:16.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.549+0000 7fc8ee73e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e81494b0 con 0x7fc8e8146cb0 2020-11-20T12:14:16.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.549+0000 7fc8ecf3b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8e8146cb0 0x7fc8e8163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8e8146cb0 0x7fc8e8163c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37814/0 (socket says 172.21.15.160:37814) 2020-11-20T12:14:16.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 -- 172.21.15.160:0/2551230276 learned_addr learned my addr 172.21.15.160:0/2551230276 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:16.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ed73c700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8e81467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8edf3d700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e8164110 0x7fc8e8143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 -- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e8164110 msgr2=0x7fc8e8143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e8164110 0x7fc8e8143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 -- 172.21.15.160:0/2551230276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 msgr2=0x7fc8e81467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8e81467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 -- 172.21.15.160:0/2551230276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e8149750 con 0x7fc8e8146cb0 2020-11-20T12:14:16.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8ecf3b700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8e8146cb0 0x7fc8e8163c20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc8d8000bc0 tx=0x7fc8d8007b70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8d57fa700 1 -- 172.21.15.160:0/2551230276 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8007020 con 0x7fc8e8146cb0 2020-11-20T12:14:16.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8d57fa700 1 -- 172.21.15.160:0/2551230276 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d8007180 con 0x7fc8e8146cb0 2020-11-20T12:14:16.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.550+0000 7fc8d57fa700 1 -- 172.21.15.160:0/2551230276 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800fa00 con 0x7fc8e8146cb0 2020-11-20T12:14:16.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.551+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e81634e0 con 0x7fc8e8146cb0 2020-11-20T12:14:16.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.551+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e8148a30 con 0x7fc8e8146cb0 2020-11-20T12:14:16.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.552+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e8163940 con 0x7fc8e8146cb0 2020-11-20T12:14:16.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.553+0000 7fc8d57fa700 1 -- 172.21.15.160:0/2551230276 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc8d800fdb0 con 0x7fc8e8146cb0 2020-11-20T12:14:16.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.554+0000 7fc8d57fa700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc8c0080630 0x7fc8c0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.554+0000 7fc8d57fa700 1 -- 172.21.15.160:0/2551230276 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fc8d80a2870 con 0x7fc8e8146cb0 2020-11-20T12:14:16.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.554+0000 7fc8ed73c700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc8c0080630 0x7fc8c0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.555+0000 7fc8ed73c700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc8c0080630 0x7fc8c0082af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc8e4000bc0 tx=0x7fc8e4015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.557+0000 7fc8d57fa700 1 -- 172.21.15.160:0/2551230276 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc8d8077470 con 0x7fc8e8146cb0 2020-11-20T12:14:16.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.744+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc8e8148ce0 con 0x7fc8e8146cb0 2020-11-20T12:14:16.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.745+0000 7fc8d57fa700 1 -- 172.21.15.160:0/2551230276 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc8d807aa90 con 0x7fc8e8146cb0 2020-11-20T12:14:16.749 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 1 2020-11-20T12:14:16.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.747+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc8c0080630 msgr2=0x7fc8c0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.747+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc8c0080630 0x7fc8c0082af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc8e4000bc0 tx=0x7fc8e4015000).stop 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.747+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8e8146cb0 msgr2=0x7fc8e8163c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.747+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8e8146cb0 0x7fc8e8163c20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc8d8000bc0 tx=0x7fc8d8007b70).stop 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 shutdown_connections 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc8c0080630 0x7fc8c0082af0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc8e8164110 0x7fc8e8143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8d0003730 0x7fc8e81467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 --2- 172.21.15.160:0/2551230276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8e8146cb0 0x7fc8e8163c20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 >> 172.21.15.160:0/2551230276 conn(0x7fc8e8060140 msgr2=0x7fc8e80657c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:16.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 shutdown_connections 2020-11-20T12:14:16.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:16.748+0000 7fc8ee73e700 1 -- 172.21.15.160:0/2551230276 wait complete. 2020-11-20T12:14:16.775 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:17.019 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.016+0000 7f22e3567700 1 Processor -- start 2020-11-20T12:14:17.020 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.016+0000 7f22e3567700 1 -- start start 2020-11-20T12:14:17.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e3567700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f22dc0bf720 0x7f22dc0bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e3567700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f22dc0c2070 0x7f22dc1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e3567700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc0c25b0 con 0x7f22dc1519a0 2020-11-20T12:14:17.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e3567700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc151e20 con 0x7f22dc0c2070 2020-11-20T12:14:17.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e3567700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc0c2850 con 0x7f22dc0bf720 2020-11-20T12:14:17.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e2565700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f22dc0bf720 0x7f22dc0bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e2565700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f22dc0bf720 0x7f22dc0bfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37820/0 (socket says 172.21.15.160:37820) 2020-11-20T12:14:17.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.018+0000 7f22e2565700 1 -- 172.21.15.160:0/1726051379 learned_addr learned my addr 172.21.15.160:0/1726051379 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:17.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e1d64700 1 --2- 172.21.15.160:0/1726051379 >> v2:172.21.15.150:3300/0 conn(0x7f22dc0c2070 0x7f22dc1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e2565700 1 -- 172.21.15.160:0/1726051379 >> v2:172.21.15.150:3300/0 conn(0x7f22dc0c2070 msgr2=0x7f22dc1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:17.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e2565700 1 --2- 172.21.15.160:0/1726051379 >> v2:172.21.15.150:3300/0 conn(0x7f22dc0c2070 0x7f22dc1514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e2565700 1 -- 172.21.15.160:0/1726051379 >> v1:172.21.15.134:6789/0 conn(0x7f22dc1519a0 legacy=0x7f22dc154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e2565700 1 -- 172.21.15.160:0/1726051379 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0c2af0 con 0x7f22dc0bf720 2020-11-20T12:14:17.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e2565700 1 --2- 172.21.15.160:0/1726051379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0bf720 0x7f22dc0bfb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f22dc0c8310 tx=0x7f22d8006eb0).ready entity=mon.2 client_cookie=ed87fdf940499ac2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e1563700 1 -- 172.21.15.160:0/1726051379 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8009960 con 0x7f22dc0bf720 2020-11-20T12:14:17.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e1563700 1 -- 172.21.15.160:0/1726051379 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8009ac0 con 0x7f22dc0bf720 2020-11-20T12:14:17.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.019+0000 7f22e1563700 1 -- 172.21.15.160:0/1726051379 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8009e40 con 0x7f22dc0bf720 2020-11-20T12:14:17.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 -- 172.21.15.160:0/1726051379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0bf720 msgr2=0x7f22dc0bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 --2- 172.21.15.160:0/1726051379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0bf720 0x7f22dc0bfb00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f22dc0c8310 tx=0x7f22d8006eb0).stop 2020-11-20T12:14:17.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 -- 172.21.15.160:0/1726051379 shutdown_connections 2020-11-20T12:14:17.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 --2- 172.21.15.160:0/1726051379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0bf720 0x7f22dc0bfb00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 --2- 172.21.15.160:0/1726051379 >> v2:172.21.15.150:3300/0 conn(0x7f22dc0c2070 0x7f22dc1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 -- 172.21.15.160:0/1726051379 >> 172.21.15.160:0/1726051379 conn(0x7f22dc060140 msgr2=0x7f22dc060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 -- 172.21.15.160:0/1726051379 shutdown_connections 2020-11-20T12:14:17.028 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.020+0000 7f22e3567700 1 -- 172.21.15.160:0/1726051379 wait complete. 2020-11-20T12:14:17.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.023+0000 7f22e3567700 1 Processor -- start 2020-11-20T12:14:17.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.023+0000 7f22e3567700 1 -- start start 2020-11-20T12:14:17.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e3567700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22dc0bf720 0x7f22dc161510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e3567700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0c2070 0x7f22dc164020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e3567700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc1519a0 0x7f22dc153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e3567700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc160070 con 0x7f22dc0bf720 2020-11-20T12:14:17.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e3567700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc146780 con 0x7f22dc1519a0 2020-11-20T12:14:17.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e3567700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc164510 con 0x7f22dc0c2070 2020-11-20T12:14:17.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e2d66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc1519a0 0x7f22dc153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.024+0000 7f22e1d64700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0c2070 0x7f22dc164020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc1519a0 0x7f22dc153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:50966/0 (socket says 172.21.15.160:50966) 2020-11-20T12:14:17.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 -- 172.21.15.160:0/140100025 learned_addr learned my addr 172.21.15.160:0/140100025 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:17.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2565700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22dc0bf720 0x7f22dc161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 -- 172.21.15.160:0/140100025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0c2070 msgr2=0x7f22dc164020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0c2070 0x7f22dc164020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 -- 172.21.15.160:0/140100025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22dc0bf720 msgr2=0x7f22dc161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22dc0bf720 0x7f22dc161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 -- 172.21.15.160:0/140100025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc146970 con 0x7f22dc1519a0 2020-11-20T12:14:17.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22e2d66700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc1519a0 0x7f22dc153f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f22d400ca90 tx=0x7f22d4001360).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22ca7fc700 1 -- 172.21.15.160:0/140100025 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400ce60 con 0x7f22dc1519a0 2020-11-20T12:14:17.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22ca7fc700 1 -- 172.21.15.160:0/140100025 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d400a730 con 0x7f22dc1519a0 2020-11-20T12:14:17.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.025+0000 7f22ca7fc700 1 -- 172.21.15.160:0/140100025 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d400aad0 con 0x7f22dc1519a0 2020-11-20T12:14:17.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.026+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc146c10 con 0x7f22dc1519a0 2020-11-20T12:14:17.036 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.026+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc160250 con 0x7f22dc1519a0 2020-11-20T12:14:17.036 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.027+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc1470b0 con 0x7f22dc1519a0 2020-11-20T12:14:17.037 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.028+0000 7f22ca7fc700 1 -- 172.21.15.160:0/140100025 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f22d4019030 con 0x7f22dc1519a0 2020-11-20T12:14:17.037 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.029+0000 7f22ca7fc700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f22b4080660 0x7f22b4082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.037 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.029+0000 7f22ca7fc700 1 -- 172.21.15.160:0/140100025 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f22d40a2040 con 0x7f22dc1519a0 2020-11-20T12:14:17.038 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.029+0000 7f22e2565700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f22b4080660 0x7f22b4082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.038 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.030+0000 7f22e2565700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f22b4080660 0x7f22b4082b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f22d8006ef0 tx=0x7f22d8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.038 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.031+0000 7f22ca7fc700 1 -- 172.21.15.160:0/140100025 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f22d4076c40 con 0x7f22dc1519a0 2020-11-20T12:14:17.221 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.218+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22dc0611e0 con 0x7f22dc1519a0 2020-11-20T12:14:17.222 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.219+0000 7f22ca7fc700 1 -- 172.21.15.160:0/140100025 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f22d407a260 con 0x7f22dc1519a0 2020-11-20T12:14:17.222 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:17.224 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f22b4080660 msgr2=0x7f22b4082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.225 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f22b4080660 0x7f22b4082b20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f22d8006ef0 tx=0x7f22d8015000).stop 2020-11-20T12:14:17.225 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc1519a0 msgr2=0x7f22dc153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc1519a0 0x7f22dc153f20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f22d400ca90 tx=0x7f22d4001360).stop 2020-11-20T12:14:17.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 shutdown_connections 2020-11-20T12:14:17.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f22b4080660 0x7f22b4082b20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f22dc1519a0 0x7f22dc153f20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22dc0bf720 0x7f22dc161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 --2- 172.21.15.160:0/140100025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0c2070 0x7f22dc164020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 >> 172.21.15.160:0/140100025 conn(0x7f22dc060140 msgr2=0x7f22dc14e680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 shutdown_connections 2020-11-20T12:14:17.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.221+0000 7f22e3567700 1 -- 172.21.15.160:0/140100025 wait complete. 2020-11-20T12:14:17.248 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T12:14:17.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.484+0000 7fe6ab564700 1 Processor -- start 2020-11-20T12:14:17.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.484+0000 7fe6ab564700 1 -- start start 2020-11-20T12:14:17.490 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6ab564700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe6a40bb650 0x7fe6a4061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6ab564700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe6a40bcf40 0x7fe6a414d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6ab564700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40bbae0 con 0x7fe6a4061870 2020-11-20T12:14:17.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6ab564700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40bbd80 con 0x7fe6a40bcf40 2020-11-20T12:14:17.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6ab564700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40bc560 con 0x7fe6a40bb650 2020-11-20T12:14:17.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6a9d61700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe6a40bb650 0x7fe6a4061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6a9d61700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe6a40bb650 0x7fe6a4061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37836/0 (socket says 172.21.15.160:37836) 2020-11-20T12:14:17.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6a9d61700 1 -- 172.21.15.160:0/2748793222 learned_addr learned my addr 172.21.15.160:0/2748793222 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:17.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6aad63700 1 --2- 172.21.15.160:0/2748793222 >> v2:172.21.15.150:3300/0 conn(0x7fe6a40bcf40 0x7fe6a414d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6a9560700 1 -- 172.21.15.160:0/2748793222 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963352401 0 0) 0x7fe6a40bbae0 con 0x7fe6a4061870 2020-11-20T12:14:17.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.486+0000 7fe6a9560700 1 -- 172.21.15.160:0/2748793222 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe68c003240 con 0x7fe6a4061870 2020-11-20T12:14:17.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9d61700 1 -- 172.21.15.160:0/2748793222 >> v2:172.21.15.150:3300/0 conn(0x7fe6a40bcf40 msgr2=0x7fe6a414d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:17.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9d61700 1 --2- 172.21.15.160:0/2748793222 >> v2:172.21.15.150:3300/0 conn(0x7fe6a40bcf40 0x7fe6a414d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9d61700 1 -- 172.21.15.160:0/2748793222 >> v1:172.21.15.134:6789/0 conn(0x7fe6a4061870 legacy=0x7fe6a4064fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9d61700 1 -- 172.21.15.160:0/2748793222 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40bc800 con 0x7fe6a40bb650 2020-11-20T12:14:17.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9d61700 1 --2- 172.21.15.160:0/2748793222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40bb650 0x7fe6a4061c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe6a4067750 tx=0x7fe694006eb0).ready entity=mon.2 client_cookie=ff9526fb34134c4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9560700 1 -- 172.21.15.160:0/2748793222 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6940097b0 con 0x7fe6a40bb650 2020-11-20T12:14:17.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9560700 1 -- 172.21.15.160:0/2748793222 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694009910 con 0x7fe6a40bb650 2020-11-20T12:14:17.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.487+0000 7fe6a9560700 1 -- 172.21.15.160:0/2748793222 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694009c90 con 0x7fe6a40bb650 2020-11-20T12:14:17.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 -- 172.21.15.160:0/2748793222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40bb650 msgr2=0x7fe6a4061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 --2- 172.21.15.160:0/2748793222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40bb650 0x7fe6a4061c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe6a4067750 tx=0x7fe694006eb0).stop 2020-11-20T12:14:17.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 -- 172.21.15.160:0/2748793222 shutdown_connections 2020-11-20T12:14:17.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 --2- 172.21.15.160:0/2748793222 >> v2:172.21.15.150:3300/0 conn(0x7fe6a40bcf40 0x7fe6a414d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 --2- 172.21.15.160:0/2748793222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40bb650 0x7fe6a4061c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 -- 172.21.15.160:0/2748793222 >> 172.21.15.160:0/2748793222 conn(0x7fe6a4060140 msgr2=0x7fe6a4060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 -- 172.21.15.160:0/2748793222 shutdown_connections 2020-11-20T12:14:17.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.488+0000 7fe6ab564700 1 -- 172.21.15.160:0/2748793222 wait complete. 2020-11-20T12:14:17.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.489+0000 7fe6ab564700 1 Processor -- start 2020-11-20T12:14:17.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.490+0000 7fe6ab564700 1 -- start start 2020-11-20T12:14:17.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.490+0000 7fe6ab564700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6a4061870 0x7fe6a41465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.490+0000 7fe6ab564700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a40bcf40 0x7fe6a4146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.490+0000 7fe6ab564700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40c26c0 0x7fe6a41445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.490+0000 7fe6ab564700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41603c0 con 0x7fe6a40bcf40 2020-11-20T12:14:17.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.490+0000 7fe6ab564700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4160660 con 0x7fe6a4061870 2020-11-20T12:14:17.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.490+0000 7fe6ab564700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4160900 con 0x7fe6a40c26c0 2020-11-20T12:14:17.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6a4061870 0x7fe6a41465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aad63700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40c26c0 0x7fe6a41445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6a4061870 0x7fe6a41465c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:50976/0 (socket says 172.21.15.160:50976) 2020-11-20T12:14:17.501 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 -- 172.21.15.160:0/3437649466 learned_addr learned my addr 172.21.15.160:0/3437649466 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:17.501 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6a9d61700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a40bcf40 0x7fe6a4146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.501 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 -- 172.21.15.160:0/3437649466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40c26c0 msgr2=0x7fe6a41445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.501 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40c26c0 0x7fe6a41445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.501 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 -- 172.21.15.160:0/3437649466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a40bcf40 msgr2=0x7fe6a4146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a40bcf40 0x7fe6a4146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.491+0000 7fe6aa562700 1 -- 172.21.15.160:0/3437649466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a4160ba0 con 0x7fe6a4061870 2020-11-20T12:14:17.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.492+0000 7fe6aa562700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6a4061870 0x7fe6a41465c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fe6a000c710 tx=0x7fe6a0007a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.492+0000 7fe6927fc700 1 -- 172.21.15.160:0/3437649466 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000e560 con 0x7fe6a4061870 2020-11-20T12:14:17.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.492+0000 7fe6927fc700 1 -- 172.21.15.160:0/3437649466 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a000e6c0 con 0x7fe6a4061870 2020-11-20T12:14:17.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.492+0000 7fe6927fc700 1 -- 172.21.15.160:0/3437649466 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000ea60 con 0x7fe6a4061870 2020-11-20T12:14:17.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.492+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a4160e40 con 0x7fe6a4061870 2020-11-20T12:14:17.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.492+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a4160010 con 0x7fe6a4061870 2020-11-20T12:14:17.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.493+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a4060840 con 0x7fe6a4061870 2020-11-20T12:14:17.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.494+0000 7fe6927fc700 1 -- 172.21.15.160:0/3437649466 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe6a0019030 con 0x7fe6a4061870 2020-11-20T12:14:17.505 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.495+0000 7fe6927fc700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe67c080630 0x7fe67c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.505 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.496+0000 7fe6927fc700 1 -- 172.21.15.160:0/3437649466 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fe6a00a1dd0 con 0x7fe6a4061870 2020-11-20T12:14:17.505 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.496+0000 7fe6a9d61700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe67c080630 0x7fe67c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.505 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.496+0000 7fe6a9d61700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe67c080630 0x7fe67c082af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe694006ef0 tx=0x7fe694015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.505 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.499+0000 7fe6927fc700 1 -- 172.21.15.160:0/3437649466 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe6a00768c0 con 0x7fe6a4061870 2020-11-20T12:14:17.689 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.686+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6a4044f60 con 0x7fe6a4061870 2020-11-20T12:14:17.690 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.687+0000 7fe6927fc700 1 -- 172.21.15.160:0/3437649466 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe6a0079ee0 con 0x7fe6a4061870 2020-11-20T12:14:17.690 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:17.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe67c080630 msgr2=0x7fe67c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe67c080630 0x7fe67c082af0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe694006ef0 tx=0x7fe694015000).stop 2020-11-20T12:14:17.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6a4061870 msgr2=0x7fe6a41465c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6a4061870 0x7fe6a41465c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fe6a000c710 tx=0x7fe6a0007a90).stop 2020-11-20T12:14:17.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 shutdown_connections 2020-11-20T12:14:17.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe67c080630 0x7fe67c082af0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6a40c26c0 0x7fe6a41445a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6a4061870 0x7fe6a41465c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 --2- 172.21.15.160:0/3437649466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6a40bcf40 0x7fe6a4146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 >> 172.21.15.160:0/3437649466 conn(0x7fe6a4060140 msgr2=0x7fe6a40c0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 shutdown_connections 2020-11-20T12:14:17.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.690+0000 7fe6ab564700 1 -- 172.21.15.160:0/3437649466 wait complete. 2020-11-20T12:14:17.715 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T12:14:17.962 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.959+0000 7f95a1d56700 1 Processor -- start 2020-11-20T12:14:17.962 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.959+0000 7f95a1d56700 1 -- start start 2020-11-20T12:14:17.964 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.960+0000 7f95a1d56700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f959c0bfb50 0x7f959c0bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.964 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.960+0000 7f95a1d56700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f959c0b9f90 0x7f959c0bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.965 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.960+0000 7f95a1d56700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c0bf3d0 con 0x7f959c14e5d0 2020-11-20T12:14:17.965 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.960+0000 7f95a1d56700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0bad90 con 0x7f959c0b9f90 2020-11-20T12:14:17.965 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.960+0000 7f95a1d56700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c14da00 con 0x7f959c0bfb50 2020-11-20T12:14:17.965 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.961+0000 7f9593fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f959c14e5d0 0x7f959c0bcd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46692/0 (socket says 172.21.15.160:46692) 2020-11-20T12:14:17.965 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.961+0000 7f9593fff700 1 -- 172.21.15.160:0/648889873 learned_addr learned my addr 172.21.15.160:0/648889873 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:17.966 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.961+0000 7f95a0d54700 1 --2- 172.21.15.160:0/648889873 >> v2:172.21.15.160:3300/0 conn(0x7f959c0bfb50 0x7f959c0bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.966 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.961+0000 7f95a1555700 1 --2- 172.21.15.160:0/648889873 >> v2:172.21.15.150:3300/0 conn(0x7f959c0b9f90 0x7f959c0bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.961+0000 7f95937fe700 1 -- 172.21.15.160:0/648889873 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819361412 0 0) 0x7f959c0bf3d0 con 0x7f959c14e5d0 2020-11-20T12:14:17.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.961+0000 7f95937fe700 1 -- 172.21.15.160:0/648889873 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9588003240 con 0x7f959c14e5d0 2020-11-20T12:14:17.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95a1555700 1 -- 172.21.15.160:0/648889873 >> v2:172.21.15.160:3300/0 conn(0x7f959c0bfb50 msgr2=0x7f959c0bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:17.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95a1555700 1 --2- 172.21.15.160:0/648889873 >> v2:172.21.15.160:3300/0 conn(0x7f959c0bfb50 0x7f959c0bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95a1555700 1 -- 172.21.15.160:0/648889873 >> v1:172.21.15.150:6789/0 conn(0x7f959c14e5d0 legacy=0x7f959c0bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95a1555700 1 -- 172.21.15.160:0/648889873 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0ba850 con 0x7f959c0b9f90 2020-11-20T12:14:17.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95a1555700 1 --2- 172.21.15.160:0/648889873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0b9f90 0x7f959c0bd890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f959c0c3f00 tx=0x7f95940091d0).ready entity=mon.1 client_cookie=58035ba1a8ddc3b5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95937fe700 1 -- 172.21.15.160:0/648889873 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959400b9c0 con 0x7f959c0b9f90 2020-11-20T12:14:17.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95937fe700 1 -- 172.21.15.160:0/648889873 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959400bb20 con 0x7f959c0b9f90 2020-11-20T12:14:17.970 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.962+0000 7f95937fe700 1 -- 172.21.15.160:0/648889873 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959400bea0 con 0x7f959c0b9f90 2020-11-20T12:14:17.970 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 -- 172.21.15.160:0/648889873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0b9f90 msgr2=0x7f959c0bd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.970 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 --2- 172.21.15.160:0/648889873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0b9f90 0x7f959c0bd890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f959c0c3f00 tx=0x7f95940091d0).stop 2020-11-20T12:14:17.970 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 -- 172.21.15.160:0/648889873 shutdown_connections 2020-11-20T12:14:17.970 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 --2- 172.21.15.160:0/648889873 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0b9f90 0x7f959c0bd890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 --2- 172.21.15.160:0/648889873 >> v2:172.21.15.160:3300/0 conn(0x7f959c0bfb50 0x7f959c0bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 -- 172.21.15.160:0/648889873 >> 172.21.15.160:0/648889873 conn(0x7f959c060140 msgr2=0x7f959c060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 -- 172.21.15.160:0/648889873 shutdown_connections 2020-11-20T12:14:17.972 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.963+0000 7f95a1d56700 1 -- 172.21.15.160:0/648889873 wait complete. 2020-11-20T12:14:17.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.965+0000 7f95a1d56700 1 Processor -- start 2020-11-20T12:14:17.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.965+0000 7f95a1d56700 1 -- start start 2020-11-20T12:14:17.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.966+0000 7f95a1d56700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c0b9f90 0x7f959c0be260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.966+0000 7f95a1d56700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0bfb50 0x7f959c15ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.966+0000 7f95a1d56700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f959c14e5d0 0x7f959c163e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.966+0000 7f95a1d56700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0be750 con 0x7f959c0b9f90 2020-11-20T12:14:17.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.966+0000 7f95a1d56700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c163520 con 0x7f959c0bfb50 2020-11-20T12:14:17.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.966+0000 7f95a1d56700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c14bdb0 con 0x7f959c14e5d0 2020-11-20T12:14:17.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f95a1555700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f959c14e5d0 0x7f959c163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f95a0d54700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c0b9f90 0x7f959c0be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f95a0d54700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c0b9f90 0x7f959c0be260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60376/0 (socket says 172.21.15.160:60376) 2020-11-20T12:14:17.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f95a0d54700 1 -- 172.21.15.160:0/3820872887 learned_addr learned my addr 172.21.15.160:0/3820872887 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:17.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f9593fff700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0bfb50 0x7f959c15ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f9593fff700 1 -- 172.21.15.160:0/3820872887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f959c14e5d0 msgr2=0x7f959c163e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f9593fff700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f959c14e5d0 0x7f959c163e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f9593fff700 1 -- 172.21.15.160:0/3820872887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c0b9f90 msgr2=0x7f959c0be260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f9593fff700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c0b9f90 0x7f959c0be260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f9593fff700 1 -- 172.21.15.160:0/3820872887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c14c010 con 0x7f959c0bfb50 2020-11-20T12:14:17.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f95a1555700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f959c14e5d0 0x7f959c163e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:17.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.967+0000 7f95a0d54700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c0b9f90 0x7f959c0be260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:17.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.968+0000 7f9593fff700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0bfb50 0x7f959c15ff70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f959c14ea30 tx=0x7f958c0079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.968+0000 7f9590ff9700 1 -- 172.21.15.160:0/3820872887 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0072e0 con 0x7f959c0bfb50 2020-11-20T12:14:17.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.968+0000 7f9590ff9700 1 -- 172.21.15.160:0/3820872887 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c007460 con 0x7f959c0bfb50 2020-11-20T12:14:17.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.968+0000 7f9590ff9700 1 -- 172.21.15.160:0/3820872887 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c005840 con 0x7f959c0bfb50 2020-11-20T12:14:17.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.968+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c14c2b0 con 0x7f959c0bfb50 2020-11-20T12:14:17.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.968+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c163750 con 0x7f959c0bfb50 2020-11-20T12:14:17.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.969+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c044f60 con 0x7f959c0bfb50 2020-11-20T12:14:17.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.971+0000 7f9590ff9700 1 -- 172.21.15.160:0/3820872887 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f958c010070 con 0x7f959c0bfb50 2020-11-20T12:14:17.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.971+0000 7f9590ff9700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9574080630 0x7f9574082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.972+0000 7f9590ff9700 1 -- 172.21.15.160:0/3820872887 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f958c0a1e80 con 0x7f959c0bfb50 2020-11-20T12:14:17.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.972+0000 7f95a0d54700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9574080630 0x7f9574082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.972+0000 7f95a0d54700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9574080630 0x7f9574082af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9598006a90 tx=0x7f9598006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:17.974+0000 7f9590ff9700 1 -- 172.21.15.160:0/3820872887 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f958c076a80 con 0x7f959c0bfb50 2020-11-20T12:14:18.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.160+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f959c0bf770 con 0x7f959c0bfb50 2020-11-20T12:14:18.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.161+0000 7f9590ff9700 1 -- 172.21.15.160:0/3820872887 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f958c018020 con 0x7f959c0bfb50 2020-11-20T12:14:18.164 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:18.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9574080630 msgr2=0x7f9574082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9574080630 0x7f9574082af0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9598006a90 tx=0x7f9598006df0).stop 2020-11-20T12:14:18.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0bfb50 msgr2=0x7f959c15ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0bfb50 0x7f959c15ff70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f959c14ea30 tx=0x7f958c0079e0).stop 2020-11-20T12:14:18.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 shutdown_connections 2020-11-20T12:14:18.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9574080630 0x7f9574082af0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f959c14e5d0 0x7f959c163e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f959c0b9f90 0x7f959c0be260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 --2- 172.21.15.160:0/3820872887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f959c0bfb50 0x7f959c15ff70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.163+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 >> 172.21.15.160:0/3820872887 conn(0x7f959c060140 msgr2=0x7f959c1400c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.164+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 shutdown_connections 2020-11-20T12:14:18.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.164+0000 7f95a1d56700 1 -- 172.21.15.160:0/3820872887 wait complete. 2020-11-20T12:14:18.191 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T12:14:18.192 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T12:14:18.192 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-20T12:14:18.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.427+0000 7f1ea1824700 1 Processor -- start 2020-11-20T12:14:18.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.427+0000 7f1ea1824700 1 -- start start 2020-11-20T12:14:18.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1ea1824700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1e9c061870 0x7f1e9c061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1ea1824700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1e9c0bb9b0 0x7f1e9c064f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1ea1824700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c150ed0 con 0x7f1e9c0c0510 2020-11-20T12:14:18.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1ea1824700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c151170 con 0x7f1e9c061870 2020-11-20T12:14:18.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1ea1824700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9c151410 con 0x7f1e9c0bb9b0 2020-11-20T12:14:18.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1e9bfff700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f1e9c0c0510 0x7f1e9c0bb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55444/0 (socket says 172.21.15.160:55444) 2020-11-20T12:14:18.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1ea1023700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1e9c0bb9b0 0x7f1e9c064f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1e9bfff700 1 -- 172.21.15.160:0/1010129743 learned_addr learned my addr 172.21.15.160:0/1010129743 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:18.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.429+0000 7f1ea0822700 1 --2- 172.21.15.160:0/1010129743 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c061870 0x7f1e9c061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.430+0000 7f1ea1023700 1 -- 172.21.15.160:0/1010129743 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c061870 msgr2=0x7f1e9c061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:18.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.430+0000 7f1ea1023700 1 --2- 172.21.15.160:0/1010129743 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c061870 0x7f1e9c061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.430+0000 7f1ea1023700 1 -- 172.21.15.160:0/1010129743 >> v1:172.21.15.160:6789/0 conn(0x7f1e9c0c0510 legacy=0x7f1e9c0bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.430+0000 7f1ea1023700 1 -- 172.21.15.160:0/1010129743 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c1516b0 con 0x7f1e9c0bb9b0 2020-11-20T12:14:18.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.430+0000 7f1ea0822700 1 --2- 172.21.15.160:0/1010129743 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c061870 0x7f1e9c061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:18.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.430+0000 7f1ea1023700 1 --2- 172.21.15.160:0/1010129743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c064f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1e9c067190 tx=0x7f1e940091d0).ready entity=mon.2 client_cookie=ae54a6583599dd72 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.433+0000 7f1e9b7fe700 1 -- 172.21.15.160:0/1010129743 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400bad0 con 0x7f1e9c0bb9b0 2020-11-20T12:14:18.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.433+0000 7f1e9b7fe700 1 -- 172.21.15.160:0/1010129743 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9400bc30 con 0x7f1e9c0bb9b0 2020-11-20T12:14:18.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.433+0000 7f1e9b7fe700 1 -- 172.21.15.160:0/1010129743 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e94011400 con 0x7f1e9c0bb9b0 2020-11-20T12:14:18.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 -- 172.21.15.160:0/1010129743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0bb9b0 msgr2=0x7f1e9c064f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 --2- 172.21.15.160:0/1010129743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c064f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1e9c067190 tx=0x7f1e940091d0).stop 2020-11-20T12:14:18.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 -- 172.21.15.160:0/1010129743 shutdown_connections 2020-11-20T12:14:18.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 --2- 172.21.15.160:0/1010129743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c064f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 --2- 172.21.15.160:0/1010129743 >> v2:172.21.15.150:3300/0 conn(0x7f1e9c061870 0x7f1e9c061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 -- 172.21.15.160:0/1010129743 >> 172.21.15.160:0/1010129743 conn(0x7f1e9c062ef0 msgr2=0x7f1e9c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 -- 172.21.15.160:0/1010129743 shutdown_connections 2020-11-20T12:14:18.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.434+0000 7f1ea1824700 1 -- 172.21.15.160:0/1010129743 wait complete. 2020-11-20T12:14:18.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.436+0000 7f1ea1824700 1 Processor -- start 2020-11-20T12:14:18.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.436+0000 7f1ea1824700 1 -- start start 2020-11-20T12:14:18.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.437+0000 7f1ea1824700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9c061870 0x7f1e9c157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.437+0000 7f1ea1824700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c13c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.437+0000 7f1ea1824700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0c0510 0x7f1e9c13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.437+0000 7f1ea1824700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c155910 con 0x7f1e9c061870 2020-11-20T12:14:18.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.437+0000 7f1ea1824700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c155bb0 con 0x7f1e9c0bb9b0 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.437+0000 7f1ea1824700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9c155e50 con 0x7f1e9c0c0510 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9c061870 0x7f1e9c157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea1023700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0c0510 0x7f1e9c13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1e9bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c13c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9c061870 0x7f1e9c157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60390/0 (socket says 172.21.15.160:60390) 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 -- 172.21.15.160:0/2448720842 learned_addr learned my addr 172.21.15.160:0/2448720842 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 -- 172.21.15.160:0/2448720842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0c0510 msgr2=0x7f1e9c13ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0c0510 0x7f1e9c13ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 -- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0bb9b0 msgr2=0x7f1e9c13c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c13c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 -- 172.21.15.160:0/2448720842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c1560f0 con 0x7f1e9c061870 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1e9bfff700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c13c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1ea0822700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9c061870 0x7f1e9c157b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1e9000ed20 tx=0x7f1e90006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.438+0000 7f1e98ff9700 1 -- 172.21.15.160:0/2448720842 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e9000cb30 con 0x7f1e9c061870 2020-11-20T12:14:18.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.439+0000 7f1e98ff9700 1 -- 172.21.15.160:0/2448720842 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9000cc90 con 0x7f1e9c061870 2020-11-20T12:14:18.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.439+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c156390 con 0x7f1e9c061870 2020-11-20T12:14:18.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.439+0000 7f1e98ff9700 1 -- 172.21.15.160:0/2448720842 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90012600 con 0x7f1e9c061870 2020-11-20T12:14:18.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.439+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c1554f0 con 0x7f1e9c061870 2020-11-20T12:14:18.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.440+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9c044f60 con 0x7f1e9c061870 2020-11-20T12:14:18.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.441+0000 7f1e98ff9700 1 -- 172.21.15.160:0/2448720842 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1e900129b0 con 0x7f1e9c061870 2020-11-20T12:14:18.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.442+0000 7f1e98ff9700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e74080660 0x7f1e74082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.443+0000 7f1e98ff9700 1 -- 172.21.15.160:0/2448720842 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f1e900a2ed0 con 0x7f1e9c061870 2020-11-20T12:14:18.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.443+0000 7f1e9bfff700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e74080660 0x7f1e74082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.443+0000 7f1e9bfff700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e74080660 0x7f1e74082b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1e9c0bda90 tx=0x7f1e88009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.446+0000 7f1e98ff9700 1 -- 172.21.15.160:0/2448720842 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1e900779c0 con 0x7f1e9c061870 2020-11-20T12:14:18.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.669+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1e9c061d80 con 0x7f1e9c061870 2020-11-20T12:14:18.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.674+0000 7f1e98ff9700 1 -- 172.21.15.160:0/2448720842 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+202044 (secure 0 0 0) 0x7f1e900a0e60 con 0x7f1e9c061870 2020-11-20T12:14:18.683 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:18.704 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":5,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":21431},{"type":"v1","addr":"172.21.15.150:6801","nonce":21431}]},"active_addr":"172.21.15.150:6801/21431","active_change":"2020-11-20T12:13:54.077826+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4104,"name":"z","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4110,"name":"x","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":579767438}]},{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3027590728}]},{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":1524370812}]}]}} 2020-11-20T12:14:18.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e74080660 msgr2=0x7f1e74082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e74080660 0x7f1e74082b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f1e9c0bda90 tx=0x7f1e88009040).stop 2020-11-20T12:14:18.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9c061870 msgr2=0x7f1e9c157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9c061870 0x7f1e9c157b70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1e9000ed20 tx=0x7f1e90006df0).stop 2020-11-20T12:14:18.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 shutdown_connections 2020-11-20T12:14:18.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1e74080660 0x7f1e74082b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9c0c0510 0x7f1e9c13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e9c061870 0x7f1e9c157b70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 --2- 172.21.15.160:0/2448720842 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1e9c0bb9b0 0x7f1e9c13c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.708 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 >> 172.21.15.160:0/2448720842 conn(0x7f1e9c062ef0 msgr2=0x7f1e9c0c0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.708 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 shutdown_connections 2020-11-20T12:14:18.708 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.680+0000 7f1ea1824700 1 -- 172.21.15.160:0/2448720842 wait complete. 2020-11-20T12:14:18.750 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T12:14:18.751 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T12:14:18.751 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:19.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.997+0000 7f20bd1ff700 1 Processor -- start 2020-11-20T12:14:19.001 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.997+0000 7f20bd1ff700 1 -- start start 2020-11-20T12:14:19.001 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.998+0000 7f20bd1ff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f20b80bc620 0x7f20b80bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.002 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20bd1ff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20b814e7f0 0x7f20b81510d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.003 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20bd1ff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b8063d10 con 0x7f20b8067190 2020-11-20T12:14:19.003 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20bd1ff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b81519a0 con 0x7f20b80bc620 2020-11-20T12:14:19.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20bd1ff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b8151c40 con 0x7f20b814e7f0 2020-11-20T12:14:19.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b77fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20b814e7f0 0x7f20b81510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b77fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f20b814e7f0 0x7f20b81510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37878/0 (socket says 172.21.15.160:37878) 2020-11-20T12:14:19.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b77fe700 1 -- 172.21.15.160:0/2691231716 learned_addr learned my addr 172.21.15.160:0/2691231716 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:19.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b7fff700 1 --2- 172.21.15.160:0/2691231716 >> v2:172.21.15.134:3300/0 conn(0x7f20b80bc620 0x7f20b80bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b77fe700 1 -- 172.21.15.160:0/2691231716 >> v2:172.21.15.134:3300/0 conn(0x7f20b80bc620 msgr2=0x7f20b80bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b77fe700 1 --2- 172.21.15.160:0/2691231716 >> v2:172.21.15.134:3300/0 conn(0x7f20b80bc620 0x7f20b80bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b77fe700 1 -- 172.21.15.160:0/2691231716 >> v1:172.21.15.150:6789/0 conn(0x7f20b8067190 legacy=0x7f20b814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b77fe700 1 -- 172.21.15.160:0/2691231716 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b8151ee0 con 0x7f20b814e7f0 2020-11-20T12:14:19.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:18.999+0000 7f20b6ffd700 1 -- 172.21.15.160:0/2691231716 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640843835 0 0) 0x7f20b8063d10 con 0x7f20b8067190 2020-11-20T12:14:19.006 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.000+0000 7f20b77fe700 1 --2- 172.21.15.160:0/2691231716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b814e7f0 0x7f20b81510d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f20b80bcef0 tx=0x7f20ac006eb0).ready entity=mon.2 client_cookie=b1eb8ae1762a4d60 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.006 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.000+0000 7f20b6ffd700 1 -- 172.21.15.160:0/2691231716 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0098a0 con 0x7f20b814e7f0 2020-11-20T12:14:19.006 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.000+0000 7f20b6ffd700 1 -- 172.21.15.160:0/2691231716 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac009a00 con 0x7f20b814e7f0 2020-11-20T12:14:19.006 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.000+0000 7f20b6ffd700 1 -- 172.21.15.160:0/2691231716 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac009d80 con 0x7f20b814e7f0 2020-11-20T12:14:19.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.000+0000 7f20bd1ff700 1 -- 172.21.15.160:0/2691231716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b814e7f0 msgr2=0x7f20b81510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.000+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/2691231716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b814e7f0 0x7f20b81510d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f20b80bcef0 tx=0x7f20ac006eb0).stop 2020-11-20T12:14:19.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.001+0000 7f20bd1ff700 1 -- 172.21.15.160:0/2691231716 shutdown_connections 2020-11-20T12:14:19.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.001+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/2691231716 >> v2:172.21.15.134:3300/0 conn(0x7f20b80bc620 0x7f20b80bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.001+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/2691231716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b814e7f0 0x7f20b81510d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.001+0000 7f20bd1ff700 1 -- 172.21.15.160:0/2691231716 >> 172.21.15.160:0/2691231716 conn(0x7f20b8062ef0 msgr2=0x7f20b8063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.001+0000 7f20bd1ff700 1 -- 172.21.15.160:0/2691231716 shutdown_connections 2020-11-20T12:14:19.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.001+0000 7f20bd1ff700 1 -- 172.21.15.160:0/2691231716 wait complete. 2020-11-20T12:14:19.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.002+0000 7f20bd1ff700 1 Processor -- start 2020-11-20T12:14:19.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.002+0000 7f20bd1ff700 1 -- start start 2020-11-20T12:14:19.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.003+0000 7f20bd1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b8067190 0x7f20b8160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.003+0000 7f20bd1ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20b80bc620 0x7f20b80bdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.003+0000 7f20bd1ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b814e7f0 0x7f20b8145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.003+0000 7f20bd1ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80c0100 con 0x7f20b814e7f0 2020-11-20T12:14:19.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.003+0000 7f20bd1ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80bf770 con 0x7f20b80bc620 2020-11-20T12:14:19.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.003+0000 7f20bd1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80bf960 con 0x7f20b8067190 2020-11-20T12:14:19.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.003+0000 7f20b7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b8067190 0x7f20b8160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b8067190 0x7f20b8160a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37882/0 (socket says 172.21.15.160:37882) 2020-11-20T12:14:19.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 -- 172.21.15.160:0/769790241 learned_addr learned my addr 172.21.15.160:0/769790241 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:19.013 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b77fe700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20b80bc620 0x7f20b80bdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.013 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20bc9fe700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b814e7f0 0x7f20b8145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.013 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 -- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20b80bc620 msgr2=0x7f20b80bdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.013 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20b80bc620 0x7f20b80bdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.013 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 -- 172.21.15.160:0/769790241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b814e7f0 msgr2=0x7f20b8145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.014 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b814e7f0 0x7f20b8145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.014 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 -- 172.21.15.160:0/769790241 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b8160f20 con 0x7f20b8067190 2020-11-20T12:14:19.014 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20b7fff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b8067190 0x7f20b8160a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f20a800ebd0 tx=0x7f20a8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.014 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f2097fff700 1 -- 172.21.15.160:0/769790241 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800c8e0 con 0x7f20b8067190 2020-11-20T12:14:19.014 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f2097fff700 1 -- 172.21.15.160:0/769790241 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800ca40 con 0x7f20b8067190 2020-11-20T12:14:19.015 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b80bfbc0 con 0x7f20b8067190 2020-11-20T12:14:19.015 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.004+0000 7f2097fff700 1 -- 172.21.15.160:0/769790241 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800cdc0 con 0x7f20b8067190 2020-11-20T12:14:19.015 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.005+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b814bba0 con 0x7f20b8067190 2020-11-20T12:14:19.015 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.006+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b80be170 con 0x7f20b8067190 2020-11-20T12:14:19.016 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.007+0000 7f2097fff700 1 -- 172.21.15.160:0/769790241 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f20a8012600 con 0x7f20b8067190 2020-11-20T12:14:19.016 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.007+0000 7f2097fff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2090080630 0x7f2090082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.008+0000 7f2097fff700 1 -- 172.21.15.160:0/769790241 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f20a80a2bf0 con 0x7f20b8067190 2020-11-20T12:14:19.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.008+0000 7f20b77fe700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2090080630 0x7f2090082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.008+0000 7f20b77fe700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2090080630 0x7f2090082af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f20ac006ef0 tx=0x7f20ac017000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.011+0000 7f2097fff700 1 -- 172.21.15.160:0/769790241 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f20a80777f0 con 0x7f20b8067190 2020-11-20T12:14:19.199 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.196+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20b8044f60 con 0x7f20b8067190 2020-11-20T12:14:19.201 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.198+0000 7f2097fff700 1 -- 172.21.15.160:0/769790241 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7f20a807ae10 con 0x7f20b8067190 2020-11-20T12:14:19.202 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:19.202 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:19.204 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2090080630 msgr2=0x7f2090082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.204 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2090080630 0x7f2090082af0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f20ac006ef0 tx=0x7f20ac017000).stop 2020-11-20T12:14:19.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b8067190 msgr2=0x7f20b8160a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b8067190 0x7f20b8160a30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f20a800ebd0 tx=0x7f20a8006df0).stop 2020-11-20T12:14:19.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 shutdown_connections 2020-11-20T12:14:19.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2090080630 0x7f2090082af0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b814e7f0 0x7f20b8145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.200+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20b8067190 0x7f20b8160a30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.201+0000 7f20bd1ff700 1 --2- 172.21.15.160:0/769790241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f20b80bc620 0x7f20b80bdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.201+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 >> 172.21.15.160:0/769790241 conn(0x7f20b8062ef0 msgr2=0x7f20b8065050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.207 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.201+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 shutdown_connections 2020-11-20T12:14:19.207 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.201+0000 7f20bd1ff700 1 -- 172.21.15.160:0/769790241 wait complete. 2020-11-20T12:14:19.226 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T12:14:19.227 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:19.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.461+0000 7f261b202700 1 Processor -- start 2020-11-20T12:14:19.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.461+0000 7f261b202700 1 -- start start 2020-11-20T12:14:19.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261b202700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2614061870 0x7f2614061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261b202700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f26140c0510 0x7f26140bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261b202700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2614150ed0 con 0x7f26140bb790 2020-11-20T12:14:19.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261b202700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2614151170 con 0x7f26140c0510 2020-11-20T12:14:19.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261b202700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2614151410 con 0x7f2614061870 2020-11-20T12:14:19.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261a200700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2614061870 0x7f2614061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261aa01700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f26140bb790 0x7f2614064f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60202/0 (socket says 172.21.15.160:60202) 2020-11-20T12:14:19.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f261aa01700 1 -- 172.21.15.160:0/1001719464 learned_addr learned my addr 172.21.15.160:0/1001719464 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:19.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.463+0000 7f26199ff700 1 --2- 172.21.15.160:0/1001719464 >> v2:172.21.15.150:3300/0 conn(0x7f26140c0510 0x7f26140bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437968271 0 0) 0x7f2614150ed0 con 0x7f26140bb790 2020-11-20T12:14:19.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25fc003240 con 0x7f26140bb790 2020-11-20T12:14:19.476 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2183628464 0 0) 0x7f25fc003240 con 0x7f26140bb790 2020-11-20T12:14:19.476 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 >> v2:172.21.15.160:3300/0 conn(0x7f2614061870 msgr2=0x7f2614061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.476 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 --2- 172.21.15.160:0/1001719464 >> v2:172.21.15.160:3300/0 conn(0x7f2614061870 0x7f2614061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.476 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 >> v2:172.21.15.150:3300/0 conn(0x7f26140c0510 msgr2=0x7f26140bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.477 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 --2- 172.21.15.160:0/1001719464 >> v2:172.21.15.150:3300/0 conn(0x7f26140c0510 0x7f26140bb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.477 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26141516b0 con 0x7f26140bb790 2020-11-20T12:14:19.477 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f260c001860 con 0x7f26140bb790 2020-11-20T12:14:19.478 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 >> v1:172.21.15.134:6789/0 conn(0x7f26140bb790 legacy=0x7f2614064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.478 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.464+0000 7f26191fe700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f25fc003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.478 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26191fe700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc0044e0 0x7f25fc004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.478 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26191fe700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25fc004e50 0x7f25fc00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.479 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614151170 con 0x7f25fc0044e0 2020-11-20T12:14:19.479 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614151410 con 0x7f25fc004e50 2020-11-20T12:14:19.479 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25fc005300 con 0x7f25fc003780 2020-11-20T12:14:19.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26199ff700 1 --2- 172.21.15.160:0/1001719464 >> v2:172.21.15.150:3300/0 conn(0x7f26140c0510 0x7f26140bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:19.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261a200700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f25fc003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261aa01700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25fc004e50 0x7f25fc00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26199ff700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc0044e0 0x7f25fc004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261a200700 1 -- 172.21.15.160:0/1001719464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25fc004e50 msgr2=0x7f25fc00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261a200700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f25fc004e50 0x7f25fc00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261a200700 1 -- 172.21.15.160:0/1001719464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc0044e0 msgr2=0x7f25fc004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261a200700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc0044e0 0x7f25fc004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261aa01700 1 -- 172.21.15.160:0/1001719464 reap_dead start 2020-11-20T12:14:19.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f261a200700 1 -- 172.21.15.160:0/1001719464 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc003240 con 0x7f25fc003780 2020-11-20T12:14:19.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.465+0000 7f26199ff700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25fc0044e0 0x7f25fc004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:19.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f261a200700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f25fc003ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2610006fd0 tx=0x7f2610006df0).ready entity=mon.2 client_cookie=8ff9167994830ad8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.483 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000b310 con 0x7f25fc003780 2020-11-20T12:14:19.483 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000ea90 con 0x7f25fc003780 2020-11-20T12:14:19.483 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f26191fe700 1 -- 172.21.15.160:0/1001719464 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261000ee10 con 0x7f25fc003780 2020-11-20T12:14:19.483 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f261b202700 1 -- 172.21.15.160:0/1001719464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 msgr2=0x7f25fc003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.484 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f261b202700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f25fc003ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2610006fd0 tx=0x7f2610006df0).stop 2020-11-20T12:14:19.484 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f261b202700 1 -- 172.21.15.160:0/1001719464 shutdown_connections 2020-11-20T12:14:19.484 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f261b202700 1 --2- 172.21.15.160:0/1001719464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f25fc003ba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.484 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.466+0000 7f261b202700 1 -- 172.21.15.160:0/1001719464 >> 172.21.15.160:0/1001719464 conn(0x7f2614062ef0 msgr2=0x7f2614063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.485 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.467+0000 7f261b202700 1 -- 172.21.15.160:0/1001719464 shutdown_connections 2020-11-20T12:14:19.485 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.467+0000 7f261b202700 1 -- 172.21.15.160:0/1001719464 wait complete. 2020-11-20T12:14:19.485 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.468+0000 7f261b202700 1 Processor -- start 2020-11-20T12:14:19.486 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.468+0000 7f261b202700 1 -- start start 2020-11-20T12:14:19.486 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261b202700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f2614154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.486 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261b202700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2614156e60 0x7f26140c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.486 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261b202700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26140c3880 0x7f2614162220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261b202700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26141550d0 con 0x7f2614156e60 2020-11-20T12:14:19.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261b202700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614115d30 con 0x7f26140c3880 2020-11-20T12:14:19.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261b202700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261414e680 con 0x7f25fc003780 2020-11-20T12:14:19.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261a200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f2614154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.488 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261a200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f2614154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37902/0 (socket says 172.21.15.160:37902) 2020-11-20T12:14:19.488 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.469+0000 7f261a200700 1 -- 172.21.15.160:0/3316376376 learned_addr learned my addr 172.21.15.160:0/3316376376 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:19.488 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261aa01700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26140c3880 0x7f2614162220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.488 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f26199ff700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2614156e60 0x7f26140c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.488 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261a200700 1 -- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26140c3880 msgr2=0x7f2614162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261a200700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26140c3880 0x7f2614162220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261a200700 1 -- 172.21.15.160:0/3316376376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2614156e60 msgr2=0x7f26140c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261a200700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2614156e60 0x7f26140c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.490 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261a200700 1 -- 172.21.15.160:0/3316376376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26141552b0 con 0x7f25fc003780 2020-11-20T12:14:19.490 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261a200700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f2614154be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f25fc005490 tx=0x7f2610019000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.490 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f26027fc700 1 -- 172.21.15.160:0/3316376376 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2610012d70 con 0x7f25fc003780 2020-11-20T12:14:19.490 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f26027fc700 1 -- 172.21.15.160:0/3316376376 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261001d410 con 0x7f25fc003780 2020-11-20T12:14:19.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26141157f0 con 0x7f25fc003780 2020-11-20T12:14:19.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.470+0000 7f26027fc700 1 -- 172.21.15.160:0/3316376376 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261001d5c0 con 0x7f25fc003780 2020-11-20T12:14:19.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.471+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2614161d80 con 0x7f25fc003780 2020-11-20T12:14:19.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.471+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2614161f40 con 0x7f25fc003780 2020-11-20T12:14:19.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.473+0000 7f26027fc700 1 -- 172.21.15.160:0/3316376376 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f261002d070 con 0x7f25fc003780 2020-11-20T12:14:19.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.474+0000 7f26027fc700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f25ec080630 0x7f25ec082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.474+0000 7f26027fc700 1 -- 172.21.15.160:0/3316376376 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f26100a4610 con 0x7f25fc003780 2020-11-20T12:14:19.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.474+0000 7f26199ff700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f25ec080630 0x7f25ec082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.474+0000 7f26199ff700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f25ec080630 0x7f25ec082af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f26140bd0d0 tx=0x7f2604008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.477+0000 7f26027fc700 1 -- 172.21.15.160:0/3316376376 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f26100791b0 con 0x7f25fc003780 2020-11-20T12:14:19.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.662+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2614044f60 con 0x7f25fc003780 2020-11-20T12:14:19.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.665+0000 7f26027fc700 1 -- 172.21.15.160:0/3316376376 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7f261002b030 con 0x7f25fc003780 2020-11-20T12:14:19.669 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:19.669 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:19.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f25ec080630 msgr2=0x7f25ec082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f25ec080630 0x7f25ec082af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f26140bd0d0 tx=0x7f2604008040).stop 2020-11-20T12:14:19.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 msgr2=0x7f2614154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f2614154be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f25fc005490 tx=0x7f2610019000).stop 2020-11-20T12:14:19.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 shutdown_connections 2020-11-20T12:14:19.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f25ec080630 0x7f25ec082af0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26140c3880 0x7f2614162220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25fc003780 0x7f2614154be0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 --2- 172.21.15.160:0/3316376376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2614156e60 0x7f26140c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 >> 172.21.15.160:0/3316376376 conn(0x7f2614062ef0 msgr2=0x7f26140c0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 shutdown_connections 2020-11-20T12:14:19.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.667+0000 7f261b202700 1 -- 172.21.15.160:0/3316376376 wait complete. 2020-11-20T12:14:19.697 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-20T12:14:19.966 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.958+0000 7f80567ea700 1 Processor -- start 2020-11-20T12:14:19.966 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.959+0000 7f80567ea700 1 -- start start 2020-11-20T12:14:19.966 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.961+0000 7f80567ea700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f80500bfa60 0x7f80500bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.961+0000 7f80567ea700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f80501555c0 0x7f8050155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.961+0000 7f80567ea700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8050155160 con 0x7f8050154400 2020-11-20T12:14:19.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.961+0000 7f80567ea700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8050155f60 con 0x7f80501555c0 2020-11-20T12:14:19.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.961+0000 7f80567ea700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8050063c20 con 0x7f80500bfa60 2020-11-20T12:14:19.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f80557e8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f80500bfa60 0x7f80500bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f8054fe7700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f80501555c0 0x7f8050155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f80557e8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f80500bfa60 0x7f80500bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37910/0 (socket says 172.21.15.160:37910) 2020-11-20T12:14:19.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f80557e8700 1 -- 172.21.15.160:0/1209562649 learned_addr learned my addr 172.21.15.160:0/1209562649 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:19.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f8054fe7700 1 -- 172.21.15.160:0/1209562649 >> v2:172.21.15.160:3300/0 conn(0x7f80500bfa60 msgr2=0x7f80500bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f8054fe7700 1 --2- 172.21.15.160:0/1209562649 >> v2:172.21.15.160:3300/0 conn(0x7f80500bfa60 0x7f80500bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f8054fe7700 1 -- 172.21.15.160:0/1209562649 >> v1:172.21.15.160:6789/0 conn(0x7f8050154400 legacy=0x7f8050154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f8054fe7700 1 -- 172.21.15.160:0/1209562649 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050158a00 con 0x7f80501555c0 2020-11-20T12:14:19.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.962+0000 7f80557e8700 1 --2- 172.21.15.160:0/1209562649 >> v2:172.21.15.160:3300/0 conn(0x7f80500bfa60 0x7f80500bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:19.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.963+0000 7f8054fe7700 1 --2- 172.21.15.160:0/1209562649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 0x7f8050155a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f80500c3fa0 tx=0x7f8040006df0).ready entity=mon.1 client_cookie=63772b4abb9b514e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.973 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.963+0000 7f803ffff700 1 -- 172.21.15.160:0/1209562649 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80400097b0 con 0x7f80501555c0 2020-11-20T12:14:19.973 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.963+0000 7f803ffff700 1 -- 172.21.15.160:0/1209562649 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8040009910 con 0x7f80501555c0 2020-11-20T12:14:19.973 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.963+0000 7f803ffff700 1 -- 172.21.15.160:0/1209562649 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8040009c90 con 0x7f80501555c0 2020-11-20T12:14:19.973 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 -- 172.21.15.160:0/1209562649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 msgr2=0x7f8050155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 --2- 172.21.15.160:0/1209562649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 0x7f8050155a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f80500c3fa0 tx=0x7f8040006df0).stop 2020-11-20T12:14:19.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 -- 172.21.15.160:0/1209562649 shutdown_connections 2020-11-20T12:14:19.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 --2- 172.21.15.160:0/1209562649 >> v2:172.21.15.160:3300/0 conn(0x7f80500bfa60 0x7f80500bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 --2- 172.21.15.160:0/1209562649 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 0x7f8050155a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 -- 172.21.15.160:0/1209562649 >> 172.21.15.160:0/1209562649 conn(0x7f8050062ef0 msgr2=0x7f8050063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 -- 172.21.15.160:0/1209562649 shutdown_connections 2020-11-20T12:14:19.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.964+0000 7f80567ea700 1 -- 172.21.15.160:0/1209562649 wait complete. 2020-11-20T12:14:19.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.966+0000 7f80567ea700 1 Processor -- start 2020-11-20T12:14:19.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.966+0000 7f80567ea700 1 -- start start 2020-11-20T12:14:19.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.967+0000 7f80567ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80500bfa60 0x7f80500bb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.967+0000 7f80567ea700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8050154400 0x7f8050064b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.967+0000 7f80567ea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 0x7f805014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.967+0000 7f80567ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805015afe0 con 0x7f80500bfa60 2020-11-20T12:14:19.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.967+0000 7f80567ea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805015ad40 con 0x7f80501555c0 2020-11-20T12:14:19.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.967+0000 7f80567ea700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805014dc60 con 0x7f8050154400 2020-11-20T12:14:19.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8050154400 0x7f8050064b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8055fe9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 0x7f805014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8050154400 0x7f8050064b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37920/0 (socket says 172.21.15.160:37920) 2020-11-20T12:14:19.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 -- 172.21.15.160:0/2769939723 learned_addr learned my addr 172.21.15.160:0/2769939723 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:19.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f80557e8700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80500bfa60 0x7f80500bb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 -- 172.21.15.160:0/2769939723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 msgr2=0x7f805014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f80501555c0 0x7f805014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 -- 172.21.15.160:0/2769939723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80500bfa60 msgr2=0x7f80500bb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80500bfa60 0x7f80500bb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 -- 172.21.15.160:0/2769939723 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805014df00 con 0x7f8050154400 2020-11-20T12:14:19.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f80557e8700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80500bfa60 0x7f80500bb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:19.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.968+0000 7f8054fe7700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8050154400 0x7f8050064b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8040006fd0 tx=0x7f8040015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.969+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8040011d50 con 0x7f8050154400 2020-11-20T12:14:19.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.969+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804001e460 con 0x7f8050154400 2020-11-20T12:14:19.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.969+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804001e7e0 con 0x7f8050154400 2020-11-20T12:14:19.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.969+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805014e1a0 con 0x7f8050154400 2020-11-20T12:14:19.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.969+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8050167a70 con 0x7f8050154400 2020-11-20T12:14:19.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.970+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8050167cf0 con 0x7f8050154400 2020-11-20T12:14:19.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.971+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8040025030 con 0x7f8050154400 2020-11-20T12:14:19.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.972+0000 7f803d7fa700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8028080630 0x7f8028082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.972+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f80400a4540 con 0x7f8050154400 2020-11-20T12:14:19.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.973+0000 7f803d7fa700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7f8028088cd0 0x7f802808b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.973+0000 7f80557e8700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8028080630 0x7f8028082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.973+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 --> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f802808b750 con 0x7f8028088cd0 2020-11-20T12:14:19.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.973+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80400a48c0 con 0x7f8050154400 2020-11-20T12:14:19.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.973+0000 7f8055fe9700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7f8028088cd0 0x7f802808b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.973+0000 7f80557e8700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8028080630 0x7f8028082af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f804c006fd0 tx=0x7f804c006eb0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.974+0000 7f8055fe9700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7f8028088cd0 0x7f802808b0f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.974+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== osd.0 v2:172.21.15.160:6804/17044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f802808b750 con 0x7f8028088cd0 2020-11-20T12:14:19.994 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.991+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 --> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f805014e600 con 0x7f8028088cd0 2020-11-20T12:14:19.995 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f803d7fa700 1 -- 172.21.15.160:0/2769939723 <== osd.0 v2:172.21.15.160:6804/17044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f805014e600 con 0x7f8028088cd0 2020-11-20T12:14:19.996 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7f8028088cd0 msgr2=0x7f802808b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.996 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f80567ea700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7f8028088cd0 0x7f802808b0f0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.996 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8028080630 msgr2=0x7f8028082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f80567ea700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8028080630 0x7f8028082af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f804c006fd0 tx=0x7f804c006eb0).stop 2020-11-20T12:14:19.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8050154400 msgr2=0x7f8050064b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f80567ea700 1 --2- 172.21.15.160:0/2769939723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8050154400 0x7f8050064b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8040006fd0 tx=0x7f8040015000).stop 2020-11-20T12:14:19.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.992+0000 7f8055fe9700 1 -- 172.21.15.160:0/2769939723 reap_dead start 2020-11-20T12:14:19.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.993+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 shutdown_connections 2020-11-20T12:14:19.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.993+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 >> 172.21.15.160:0/2769939723 conn(0x7f8050062ef0 msgr2=0x7f80500c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.993+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 shutdown_connections 2020-11-20T12:14:19.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:19.993+0000 7f80567ea700 1 -- 172.21.15.160:0/2769939723 wait complete. 2020-11-20T12:14:20.017 INFO:teuthology.orchestra.run.smithi160.stdout:73014444038 2020-11-20T12:14:20.017 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-20T12:14:20.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.279+0000 7f8edba95700 1 Processor -- start 2020-11-20T12:14:20.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.279+0000 7f8edba95700 1 -- start start 2020-11-20T12:14:20.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8edba95700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ed40c3270 0x7f8ed40c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8edba95700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ed4151250 0x7f8ed41516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8edba95700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed4150370 con 0x7f8ed4151bc0 2020-11-20T12:14:20.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8edba95700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed40bbe40 con 0x7f8ed40c3270 2020-11-20T12:14:20.286 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8edba95700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed41505d0 con 0x7f8ed4151250 2020-11-20T12:14:20.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8ed9030700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ed4151250 0x7f8ed41516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8ed9030700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f8ed4151250 0x7f8ed41516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51062/0 (socket says 172.21.15.160:51062) 2020-11-20T12:14:20.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8ed9030700 1 -- 172.21.15.160:0/1258984629 learned_addr learned my addr 172.21.15.160:0/1258984629 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:20.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8ed9831700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8ed40c3270 0x7f8ed40c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.281+0000 7f8eda032700 1 --1- 172.21.15.160:0/1258984629 >> v1:172.21.15.150:6789/0 conn(0x7f8ed4151bc0 0x7f8ed41523d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46774/0 (socket says 172.21.15.160:46774) 2020-11-20T12:14:20.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed9030700 1 -- 172.21.15.160:0/1258984629 >> v2:172.21.15.134:3300/0 conn(0x7f8ed40c3270 msgr2=0x7f8ed40c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:20.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed9030700 1 --2- 172.21.15.160:0/1258984629 >> v2:172.21.15.134:3300/0 conn(0x7f8ed40c3270 0x7f8ed40c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed9030700 1 -- 172.21.15.160:0/1258984629 >> v1:172.21.15.150:6789/0 conn(0x7f8ed4151bc0 legacy=0x7f8ed41523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed882f700 1 -- 172.21.15.160:0/1258984629 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2703546427 0 0) 0x7f8ed4150370 con 0x7f8ed4151bc0 2020-11-20T12:14:20.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed9030700 1 -- 172.21.15.160:0/1258984629 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4150870 con 0x7f8ed4151250 2020-11-20T12:14:20.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed9030700 1 --2- 172.21.15.160:0/1258984629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151250 0x7f8ed41516d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8ed40c3b40 tx=0x7f8ec4006eb0).ready entity=mon.1 client_cookie=51a9991ee4627a53 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed882f700 1 -- 172.21.15.160:0/1258984629 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4009810 con 0x7f8ed4151250 2020-11-20T12:14:20.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed882f700 1 -- 172.21.15.160:0/1258984629 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec4009970 con 0x7f8ed4151250 2020-11-20T12:14:20.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.282+0000 7f8ed882f700 1 -- 172.21.15.160:0/1258984629 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4009cf0 con 0x7f8ed4151250 2020-11-20T12:14:20.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 -- 172.21.15.160:0/1258984629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151250 msgr2=0x7f8ed41516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 --2- 172.21.15.160:0/1258984629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151250 0x7f8ed41516d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8ed40c3b40 tx=0x7f8ec4006eb0).stop 2020-11-20T12:14:20.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 -- 172.21.15.160:0/1258984629 shutdown_connections 2020-11-20T12:14:20.296 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 --2- 172.21.15.160:0/1258984629 >> v2:172.21.15.134:3300/0 conn(0x7f8ed40c3270 0x7f8ed40c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.296 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 --2- 172.21.15.160:0/1258984629 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151250 0x7f8ed41516d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.296 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 -- 172.21.15.160:0/1258984629 >> 172.21.15.160:0/1258984629 conn(0x7f8ed40b99a0 msgr2=0x7f8ed4060140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:20.297 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 -- 172.21.15.160:0/1258984629 shutdown_connections 2020-11-20T12:14:20.297 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.283+0000 7f8edba95700 1 -- 172.21.15.160:0/1258984629 wait complete. 2020-11-20T12:14:20.297 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.285+0000 7f8edba95700 1 Processor -- start 2020-11-20T12:14:20.298 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.285+0000 7f8edba95700 1 -- start start 2020-11-20T12:14:20.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8edba95700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40c3270 0x7f8ed4164380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8edba95700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed4151250 0x7f8ed4156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8edba95700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151bc0 0x7f8ed4137eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8edba95700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed40bfec0 con 0x7f8ed40c3270 2020-11-20T12:14:20.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8edba95700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed4164870 con 0x7f8ed4151bc0 2020-11-20T12:14:20.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8edba95700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed41570e0 con 0x7f8ed4151250 2020-11-20T12:14:20.305 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8ed9030700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed4151250 0x7f8ed4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.305 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8ed9831700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40c3270 0x7f8ed4164380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.305 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8ed9030700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed4151250 0x7f8ed4156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37934/0 (socket says 172.21.15.160:37934) 2020-11-20T12:14:20.306 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8ed9030700 1 -- 172.21.15.160:0/156505613 learned_addr learned my addr 172.21.15.160:0/156505613 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:20.306 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.286+0000 7f8eda032700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151bc0 0x7f8ed4137eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.306 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ed9030700 1 -- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151bc0 msgr2=0x7f8ed4137eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.307 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ed9030700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ed4151bc0 0x7f8ed4137eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.307 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ed9030700 1 -- 172.21.15.160:0/156505613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40c3270 msgr2=0x7f8ed4164380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ed9030700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40c3270 0x7f8ed4164380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ed9030700 1 -- 172.21.15.160:0/156505613 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed4157380 con 0x7f8ed4151250 2020-11-20T12:14:20.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ed9831700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed40c3270 0x7f8ed4164380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:20.309 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ed9030700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed4151250 0x7f8ed4156580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8ec400b1b0 tx=0x7f8ec4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.309 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4011dd0 con 0x7f8ed4151250 2020-11-20T12:14:20.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec401e460 con 0x7f8ed4151250 2020-11-20T12:14:20.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed40c00b0 con 0x7f8ed4151250 2020-11-20T12:14:20.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec401e7e0 con 0x7f8ed4151250 2020-11-20T12:14:20.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.287+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed40c05f0 con 0x7f8ed4151250 2020-11-20T12:14:20.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.288+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ed4069460 con 0x7f8ed4151250 2020-11-20T12:14:20.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.289+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8ec4025030 con 0x7f8ed4151250 2020-11-20T12:14:20.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.290+0000 7f8ec1ffb700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8eac080660 0x7f8eac082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.291+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f8ec40a3ee0 con 0x7f8ed4151250 2020-11-20T12:14:20.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.291+0000 7f8ec1ffb700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8eac088d00 0x7f8eac08b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.291+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 --> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8eac08b780 con 0x7f8eac088d00 2020-11-20T12:14:20.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.291+0000 7f8ed9831700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8eac080660 0x7f8eac082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.291+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec40a6550 con 0x7f8ed4151250 2020-11-20T12:14:20.314 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.291+0000 7f8eda032700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8eac088d00 0x7f8eac08b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.314 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.291+0000 7f8ed9831700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8eac080660 0x7f8eac082b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8ed0006fd0 tx=0x7f8ed0006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.314 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.292+0000 7f8eda032700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8eac088d00 0x7f8eac08b120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.315 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.293+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== osd.1 v2:172.21.15.150:6802/21742 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f8eac08b780 con 0x7f8eac088d00 2020-11-20T12:14:20.317 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.309+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 --> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ed40c0780 con 0x7f8eac088d00 2020-11-20T12:14:20.317 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.310+0000 7f8ec1ffb700 1 -- 172.21.15.160:0/156505613 <== osd.1 v2:172.21.15.150:6802/21742 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ed40c0780 con 0x7f8eac088d00 2020-11-20T12:14:20.317 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8eac088d00 msgr2=0x7f8eac08b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.318 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8eac088d00 0x7f8eac08b120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.318 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8eac080660 msgr2=0x7f8eac082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8eac080660 0x7f8eac082b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8ed0006fd0 tx=0x7f8ed0006df0).stop 2020-11-20T12:14:20.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed4151250 msgr2=0x7f8ed4156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 --2- 172.21.15.160:0/156505613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ed4151250 0x7f8ed4156580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8ec400b1b0 tx=0x7f8ec4015000).stop 2020-11-20T12:14:20.320 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8eda032700 1 -- 172.21.15.160:0/156505613 reap_dead start 2020-11-20T12:14:20.320 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 shutdown_connections 2020-11-20T12:14:20.320 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 >> 172.21.15.160:0/156505613 conn(0x7f8ed40b99a0 msgr2=0x7f8ed4139140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:20.321 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 shutdown_connections 2020-11-20T12:14:20.321 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.311+0000 7f8edba95700 1 -- 172.21.15.160:0/156505613 wait complete. 2020-11-20T12:14:20.337 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:20.337 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-20T12:14:20.589 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.585+0000 7f5a0a482700 1 Processor -- start 2020-11-20T12:14:20.589 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.585+0000 7f5a0a482700 1 -- start start 2020-11-20T12:14:20.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a0a482700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a040630b0 0x7f5a04063490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a0a482700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5a0414fc90 0x7f5a04150100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a0a482700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040c3a80 con 0x7f5a040c24d0 2020-11-20T12:14:20.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a0a482700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a040c4c30 con 0x7f5a0414fc90 2020-11-20T12:14:20.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a0a482700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a040c3d10 con 0x7f5a040630b0 2020-11-20T12:14:20.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a09480700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5a040630b0 0x7f5a04063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a08c7f700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f5a040c24d0 0x7f5a040c2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46788/0 (socket says 172.21.15.160:46788) 2020-11-20T12:14:20.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.587+0000 7f5a08c7f700 1 -- 172.21.15.160:0/3463422615 learned_addr learned my addr 172.21.15.160:0/3463422615 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:20.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f59f3fff700 1 -- 172.21.15.160:0/3463422615 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239699659 0 0) 0x7f5a040c3a80 con 0x7f5a040c24d0 2020-11-20T12:14:20.600 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f59f3fff700 1 -- 172.21.15.160:0/3463422615 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59ec003240 con 0x7f5a040c24d0 2020-11-20T12:14:20.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f5a09c81700 1 --2- 172.21.15.160:0/3463422615 >> v2:172.21.15.134:3300/0 conn(0x7f5a0414fc90 0x7f5a04150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f5a09480700 1 -- 172.21.15.160:0/3463422615 >> v2:172.21.15.134:3300/0 conn(0x7f5a0414fc90 msgr2=0x7f5a04150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:20.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f5a09480700 1 --2- 172.21.15.160:0/3463422615 >> v2:172.21.15.134:3300/0 conn(0x7f5a0414fc90 0x7f5a04150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f5a09480700 1 -- 172.21.15.160:0/3463422615 >> v1:172.21.15.150:6789/0 conn(0x7f5a040c24d0 legacy=0x7f5a040c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f5a09480700 1 -- 172.21.15.160:0/3463422615 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a040c3fb0 con 0x7f5a040630b0 2020-11-20T12:14:20.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f5a09c81700 1 --2- 172.21.15.160:0/3463422615 >> v2:172.21.15.134:3300/0 conn(0x7f5a0414fc90 0x7f5a04150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:20.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f5a09480700 1 --2- 172.21.15.160:0/3463422615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 0x7f5a04063490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5a040c8370 tx=0x7f5a00006df0).ready entity=mon.1 client_cookie=a3327d6e82ca8208 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f59f3fff700 1 -- 172.21.15.160:0/3463422615 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00009840 con 0x7f5a040630b0 2020-11-20T12:14:20.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f59f3fff700 1 -- 172.21.15.160:0/3463422615 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a000099a0 con 0x7f5a040630b0 2020-11-20T12:14:20.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.588+0000 7f59f3fff700 1 -- 172.21.15.160:0/3463422615 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00009d20 con 0x7f5a040630b0 2020-11-20T12:14:20.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 -- 172.21.15.160:0/3463422615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 msgr2=0x7f5a04063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 --2- 172.21.15.160:0/3463422615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 0x7f5a04063490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f5a040c8370 tx=0x7f5a00006df0).stop 2020-11-20T12:14:20.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 -- 172.21.15.160:0/3463422615 shutdown_connections 2020-11-20T12:14:20.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 --2- 172.21.15.160:0/3463422615 >> v2:172.21.15.134:3300/0 conn(0x7f5a0414fc90 0x7f5a04150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 --2- 172.21.15.160:0/3463422615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 0x7f5a04063490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 -- 172.21.15.160:0/3463422615 >> 172.21.15.160:0/3463422615 conn(0x7f5a04060140 msgr2=0x7f5a04060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:20.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 -- 172.21.15.160:0/3463422615 shutdown_connections 2020-11-20T12:14:20.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.589+0000 7f5a0a482700 1 -- 172.21.15.160:0/3463422615 wait complete. 2020-11-20T12:14:20.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.591+0000 7f5a0a482700 1 Processor -- start 2020-11-20T12:14:20.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.591+0000 7f5a0a482700 1 -- start start 2020-11-20T12:14:20.613 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a0a482700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 0x7f5a04157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.613 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a0a482700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040c24d0 0x7f5a04143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a0a482700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a0414fc90 0x7f5a04143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a0a482700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a04151050 con 0x7f5a040c24d0 2020-11-20T12:14:20.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a0a482700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a041501a0 con 0x7f5a040630b0 2020-11-20T12:14:20.615 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a0a482700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a041503d0 con 0x7f5a0414fc90 2020-11-20T12:14:20.615 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a09c81700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a0414fc90 0x7f5a04143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.615 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a09480700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 0x7f5a04157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.616 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a09c81700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a0414fc90 0x7f5a04143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37952/0 (socket says 172.21.15.160:37952) 2020-11-20T12:14:20.616 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a09c81700 1 -- 172.21.15.160:0/1798250525 learned_addr learned my addr 172.21.15.160:0/1798250525 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:20.616 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.592+0000 7f5a08c7f700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040c24d0 0x7f5a04143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a09c81700 1 -- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 msgr2=0x7f5a04157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a09c81700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 0x7f5a04157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a09c81700 1 -- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040c24d0 msgr2=0x7f5a04143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.618 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a09c81700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a040c24d0 0x7f5a04143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.618 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a09c81700 1 -- 172.21.15.160:0/1798250525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a04150670 con 0x7f5a0414fc90 2020-11-20T12:14:20.618 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a09480700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5a040630b0 0x7f5a04157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:20.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a09c81700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a0414fc90 0x7f5a04143600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f59fc00cb80 tx=0x7f59fc008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc007830 con 0x7f5a0414fc90 2020-11-20T12:14:20.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc007990 con 0x7f5a0414fc90 2020-11-20T12:14:20.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a04150910 con 0x7f5a0414fc90 2020-11-20T12:14:20.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a04164210 con 0x7f5a0414fc90 2020-11-20T12:14:20.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.593+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc007d10 con 0x7f5a0414fc90 2020-11-20T12:14:20.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.594+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a0414cc70 con 0x7f5a0414fc90 2020-11-20T12:14:20.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.596+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f59fc011620 con 0x7f5a0414fc90 2020-11-20T12:14:20.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.597+0000 7f59f17fa700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59dc080660 0x7f59dc082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.597+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f59fc0a3550 con 0x7f5a0414fc90 2020-11-20T12:14:20.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.597+0000 7f59f17fa700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7f59dc088c80 0x7f59dc08b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.597+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 --> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59dc08b700 con 0x7f59dc088c80 2020-11-20T12:14:20.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.597+0000 7f5a09480700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59dc080660 0x7f59dc082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.597+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59fc0a3950 con 0x7f5a0414fc90 2020-11-20T12:14:20.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.597+0000 7f5a08c7f700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7f59dc088c80 0x7f59dc08b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.598+0000 7f5a09480700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59dc080660 0x7f59dc082b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5a00006e30 tx=0x7f5a00015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.598+0000 7f5a08c7f700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7f59dc088c80 0x7f59dc08b0a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.599+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== osd.2 v2:172.21.15.134:6800/22183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f59dc08b700 con 0x7f59dc088c80 2020-11-20T12:14:20.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.615+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 --> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a04044f60 con 0x7f59dc088c80 2020-11-20T12:14:20.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.616+0000 7f59f17fa700 1 -- 172.21.15.160:0/1798250525 <== osd.2 v2:172.21.15.134:6800/22183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a04044f60 con 0x7f59dc088c80 2020-11-20T12:14:20.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.616+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7f59dc088c80 msgr2=0x7f59dc08b0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.616+0000 7f5a0a482700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7f59dc088c80 0x7f59dc08b0a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59dc080660 msgr2=0x7f59dc082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59dc080660 0x7f59dc082b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f5a00006e30 tx=0x7f5a00015000).stop 2020-11-20T12:14:20.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a0414fc90 msgr2=0x7f5a04143600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 --2- 172.21.15.160:0/1798250525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a0414fc90 0x7f5a04143600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f59fc00cb80 tx=0x7f59fc008040).stop 2020-11-20T12:14:20.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a09c81700 1 -- 172.21.15.160:0/1798250525 reap_dead start 2020-11-20T12:14:20.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 shutdown_connections 2020-11-20T12:14:20.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 >> 172.21.15.160:0/1798250525 conn(0x7f5a04060140 msgr2=0x7f5a04152020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:20.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 shutdown_connections 2020-11-20T12:14:20.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.617+0000 7f5a0a482700 1 -- 172.21.15.160:0/1798250525 wait complete. 2020-11-20T12:14:20.642 INFO:teuthology.orchestra.run.smithi160.stdout:73014444038 2020-11-20T12:14:20.643 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-20T12:14:20.661 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:20.672 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:20.685 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:20.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.879+0000 7f541e326700 1 Processor -- start 2020-11-20T12:14:20.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.880+0000 7f541e326700 1 -- start start 2020-11-20T12:14:20.885 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.881+0000 7f541e326700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f54180bfa20 0x7f54180bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.885 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.881+0000 7f541e326700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5418065330 0x7f54180baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.881+0000 7f541e326700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54180bb3e0 0x7f5418150c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.881+0000 7f541e326700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54180bb890 con 0x7f5418065330 2020-11-20T12:14:20.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.881+0000 7f541e326700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54181543e0 con 0x7f54180bb3e0 2020-11-20T12:14:20.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.881+0000 7f541e326700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5418154680 con 0x7f54180bfa20 2020-11-20T12:14:20.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541db25700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54180bb3e0 0x7f5418150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541cb23700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5418065330 0x7f54180baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541cb23700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5418065330 0x7f54180baef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60484/0 (socket says 172.21.15.160:60484) 2020-11-20T12:14:20.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541cb23700 1 -- 172.21.15.160:0/4186943327 learned_addr learned my addr 172.21.15.160:0/4186943327 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:20.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541db25700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f54180bb3e0 0x7f5418150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51096/0 (socket says 172.21.15.160:51096) 2020-11-20T12:14:20.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541d324700 1 --2- 172.21.15.160:0/4186943327 >> v2:172.21.15.160:3300/0 conn(0x7f54180bfa20 0x7f54180bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541cb23700 1 -- 172.21.15.160:0/4186943327 >> v2:172.21.15.160:3300/0 conn(0x7f54180bfa20 msgr2=0x7f54180bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:20.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541cb23700 1 --2- 172.21.15.160:0/4186943327 >> v2:172.21.15.160:3300/0 conn(0x7f54180bfa20 0x7f54180bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.882+0000 7f541cb23700 1 -- 172.21.15.160:0/4186943327 >> v2:172.21.15.150:3300/0 conn(0x7f54180bb3e0 msgr2=0x7f5418150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:20.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.883+0000 7f541cb23700 1 --2- 172.21.15.160:0/4186943327 >> v2:172.21.15.150:3300/0 conn(0x7f54180bb3e0 0x7f5418150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.883+0000 7f541cb23700 1 -- 172.21.15.160:0/4186943327 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418154920 con 0x7f5418065330 2020-11-20T12:14:20.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.883+0000 7f541db25700 1 --2- 172.21.15.160:0/4186943327 >> v2:172.21.15.150:3300/0 conn(0x7f54180bb3e0 0x7f5418150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:20.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.883+0000 7f541cb23700 1 --2- 172.21.15.160:0/4186943327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418065330 0x7f54180baef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f54180bad00 tx=0x7f5408006eb0).ready entity=mon.0 client_cookie=7ec2af2743e9a230 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.883+0000 7f5407fff700 1 -- 172.21.15.160:0/4186943327 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080097b0 con 0x7f5418065330 2020-11-20T12:14:20.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.883+0000 7f5407fff700 1 -- 172.21.15.160:0/4186943327 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408009910 con 0x7f5418065330 2020-11-20T12:14:20.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.883+0000 7f5407fff700 1 -- 172.21.15.160:0/4186943327 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408009c90 con 0x7f5418065330 2020-11-20T12:14:20.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 -- 172.21.15.160:0/4186943327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418065330 msgr2=0x7f54180baef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 --2- 172.21.15.160:0/4186943327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418065330 0x7f54180baef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f54180bad00 tx=0x7f5408006eb0).stop 2020-11-20T12:14:20.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 -- 172.21.15.160:0/4186943327 shutdown_connections 2020-11-20T12:14:20.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 --2- 172.21.15.160:0/4186943327 >> v2:172.21.15.160:3300/0 conn(0x7f54180bfa20 0x7f54180bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 --2- 172.21.15.160:0/4186943327 >> v2:172.21.15.150:3300/0 conn(0x7f54180bb3e0 0x7f5418150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 --2- 172.21.15.160:0/4186943327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5418065330 0x7f54180baef0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 -- 172.21.15.160:0/4186943327 >> 172.21.15.160:0/4186943327 conn(0x7f5418062ef0 msgr2=0x7f5418063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:20.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 -- 172.21.15.160:0/4186943327 shutdown_connections 2020-11-20T12:14:20.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.884+0000 7f541e326700 1 -- 172.21.15.160:0/4186943327 wait complete. 2020-11-20T12:14:20.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.886+0000 7f541e326700 1 Processor -- start 2020-11-20T12:14:20.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.886+0000 7f541e326700 1 -- start start 2020-11-20T12:14:20.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.887+0000 7f541e326700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5418065330 0x7f5418160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.887+0000 7f541e326700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54180bb3e0 0x7f5418063490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.887+0000 7f541e326700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54180bfa20 0x7f541814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.887+0000 7f541e326700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180c2c80 con 0x7f54180bfa20 2020-11-20T12:14:20.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.887+0000 7f541e326700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418163840 con 0x7f54180bb3e0 2020-11-20T12:14:20.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.887+0000 7f541e326700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5418163ae0 con 0x7f5418065330 2020-11-20T12:14:20.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541db25700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54180bfa20 0x7f541814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541d324700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5418065330 0x7f5418160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541db25700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54180bfa20 0x7f541814dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60490/0 (socket says 172.21.15.160:60490) 2020-11-20T12:14:20.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541db25700 1 -- 172.21.15.160:0/3297671828 learned_addr learned my addr 172.21.15.160:0/3297671828 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:20.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541cb23700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54180bb3e0 0x7f5418063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541d324700 1 -- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54180bb3e0 msgr2=0x7f5418063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541d324700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f54180bb3e0 0x7f5418063490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541d324700 1 -- 172.21.15.160:0/3297671828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54180bfa20 msgr2=0x7f541814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541d324700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54180bfa20 0x7f541814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.888+0000 7f541d324700 1 -- 172.21.15.160:0/3297671828 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418163d80 con 0x7f5418065330 2020-11-20T12:14:20.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.889+0000 7f541d324700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5418065330 0x7f5418160b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f541400eba0 tx=0x7f5414006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.889+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400b8a0 con 0x7f5418065330 2020-11-20T12:14:20.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.889+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541400ba00 con 0x7f5418065330 2020-11-20T12:14:20.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.889+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541400bd80 con 0x7f5418065330 2020-11-20T12:14:20.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.889+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5418164020 con 0x7f5418065330 2020-11-20T12:14:20.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.889+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5418163500 con 0x7f5418065330 2020-11-20T12:14:20.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.890+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5418044f60 con 0x7f5418065330 2020-11-20T12:14:20.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.891+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5414012600 con 0x7f5418065330 2020-11-20T12:14:20.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.892+0000 7f54057fa700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f53f0080630 0x7f53f0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.893+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f54140a3560 con 0x7f5418065330 2020-11-20T12:14:20.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.893+0000 7f54057fa700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f53f0088cd0 0x7f53f008b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.893+0000 7f541cb23700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f53f0080630 0x7f53f0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.893+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 --> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53f008b750 con 0x7f53f0088cd0 2020-11-20T12:14:20.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.893+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54140a3960 con 0x7f5418065330 2020-11-20T12:14:20.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.893+0000 7f541db25700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f53f0088cd0 0x7f53f008b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.893+0000 7f541cb23700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f53f0080630 0x7f53f0082af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f54180bad00 tx=0x7f5408015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.894+0000 7f541db25700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f53f0088cd0 0x7f53f008b0f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.895+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== osd.3 v2:172.21.15.160:6800/17043 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f53f008b750 con 0x7f53f0088cd0 2020-11-20T12:14:20.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.911+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 --> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f54180c2e40 con 0x7f53f0088cd0 2020-11-20T12:14:20.917 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.912+0000 7f54057fa700 1 -- 172.21.15.160:0/3297671828 <== osd.3 v2:172.21.15.160:6800/17043 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5410014410 con 0x7f53f0088cd0 2020-11-20T12:14:20.917 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.912+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f53f0088cd0 msgr2=0x7f53f008b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.912+0000 7f541e326700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f53f0088cd0 0x7f53f008b0f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.912+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f53f0080630 msgr2=0x7f53f0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.912+0000 7f541e326700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f53f0080630 0x7f53f0082af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f54180bad00 tx=0x7f5408015000).stop 2020-11-20T12:14:20.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.912+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5418065330 msgr2=0x7f5418160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.912+0000 7f541e326700 1 --2- 172.21.15.160:0/3297671828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5418065330 0x7f5418160b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f541400eba0 tx=0x7f5414006df0).stop 2020-11-20T12:14:20.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.913+0000 7f541db25700 1 -- 172.21.15.160:0/3297671828 reap_dead start 2020-11-20T12:14:20.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.913+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 shutdown_connections 2020-11-20T12:14:20.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.913+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 >> 172.21.15.160:0/3297671828 conn(0x7f5418062ef0 msgr2=0x7f541814c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:20.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.913+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 shutdown_connections 2020-11-20T12:14:20.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:20.913+0000 7f541e326700 1 -- 172.21.15.160:0/3297671828 wait complete. 2020-11-20T12:14:20.935 INFO:teuthology.orchestra.run.smithi160.stdout:73014444038 2020-11-20T12:14:20.936 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-20T12:14:21.179 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.175+0000 7fe602665700 1 Processor -- start 2020-11-20T12:14:21.179 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.175+0000 7fe602665700 1 -- start start 2020-11-20T12:14:21.180 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe602665700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe5fc0bfa20 0x7fe5fc0bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe602665700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5fc065330 0x7fe5fc0baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe602665700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe5fc0bb3e0 0x7fe5fc150c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe602665700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc0bb890 con 0x7fe5fc0bfa20 2020-11-20T12:14:21.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe602665700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc1543e0 con 0x7fe5fc065330 2020-11-20T12:14:21.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe602665700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc154680 con 0x7fe5fc0bb3e0 2020-11-20T12:14:21.183 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe600e62700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5fc065330 0x7fe5fc0baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.183 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.177+0000 7fe601e64700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe5fc0bb3e0 0x7fe5fc150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.183 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe5fc065330 0x7fe5fc0baef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51110/0 (socket says 172.21.15.160:51110) 2020-11-20T12:14:21.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 -- 172.21.15.160:0/1067023976 learned_addr learned my addr 172.21.15.160:0/1067023976 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:21.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe601663700 1 --2- 172.21.15.160:0/1067023976 >> v2:172.21.15.134:3300/0 conn(0x7fe5fc0bfa20 0x7fe5fc0bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 -- 172.21.15.160:0/1067023976 >> v2:172.21.15.160:3300/0 conn(0x7fe5fc0bb3e0 msgr2=0x7fe5fc150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:21.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 --2- 172.21.15.160:0/1067023976 >> v2:172.21.15.160:3300/0 conn(0x7fe5fc0bb3e0 0x7fe5fc150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 -- 172.21.15.160:0/1067023976 >> v2:172.21.15.134:3300/0 conn(0x7fe5fc0bfa20 msgr2=0x7fe5fc0bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:21.185 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 --2- 172.21.15.160:0/1067023976 >> v2:172.21.15.134:3300/0 conn(0x7fe5fc0bfa20 0x7fe5fc0bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.185 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 -- 172.21.15.160:0/1067023976 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc154920 con 0x7fe5fc065330 2020-11-20T12:14:21.185 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.178+0000 7fe600e62700 1 --2- 172.21.15.160:0/1067023976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc0baef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fe5fc067690 tx=0x7fe5ec006eb0).ready entity=mon.1 client_cookie=bc6f2a615ad4f329 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.185 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe5ebfff700 1 -- 172.21.15.160:0/1067023976 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0097b0 con 0x7fe5fc065330 2020-11-20T12:14:21.185 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe5ebfff700 1 -- 172.21.15.160:0/1067023976 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec009910 con 0x7fe5fc065330 2020-11-20T12:14:21.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe5ebfff700 1 -- 172.21.15.160:0/1067023976 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec009c90 con 0x7fe5fc065330 2020-11-20T12:14:21.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 -- 172.21.15.160:0/1067023976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 msgr2=0x7fe5fc0baef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 --2- 172.21.15.160:0/1067023976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc0baef0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fe5fc067690 tx=0x7fe5ec006eb0).stop 2020-11-20T12:14:21.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 -- 172.21.15.160:0/1067023976 shutdown_connections 2020-11-20T12:14:21.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 --2- 172.21.15.160:0/1067023976 >> v2:172.21.15.160:3300/0 conn(0x7fe5fc0bb3e0 0x7fe5fc150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.187 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 --2- 172.21.15.160:0/1067023976 >> v2:172.21.15.134:3300/0 conn(0x7fe5fc0bfa20 0x7fe5fc0bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.187 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 --2- 172.21.15.160:0/1067023976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc0baef0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.189 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 -- 172.21.15.160:0/1067023976 >> 172.21.15.160:0/1067023976 conn(0x7fe5fc062ef0 msgr2=0x7fe5fc063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.189 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 -- 172.21.15.160:0/1067023976 shutdown_connections 2020-11-20T12:14:21.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.179+0000 7fe602665700 1 -- 172.21.15.160:0/1067023976 wait complete. 2020-11-20T12:14:21.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.181+0000 7fe602665700 1 Processor -- start 2020-11-20T12:14:21.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.182+0000 7fe602665700 1 -- start start 2020-11-20T12:14:21.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe602665700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe602665700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5fc0bb3e0 0x7fe5fc163d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe602665700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5fc0bfa20 0x7fe5fc0c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe602665700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc14d8b0 con 0x7fe5fc0bfa20 2020-11-20T12:14:21.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe602665700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc14fb00 con 0x7fe5fc065330 2020-11-20T12:14:21.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe602665700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc14fd60 con 0x7fe5fc0bb3e0 2020-11-20T12:14:21.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe600e62700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5fc0bb3e0 0x7fe5fc163d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe601663700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe601663700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51118/0 (socket says 172.21.15.160:51118) 2020-11-20T12:14:21.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe601e64700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5fc0bfa20 0x7fe5fc0c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe600e62700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5fc0bb3e0 0x7fe5fc163d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37980/0 (socket says 172.21.15.160:37980) 2020-11-20T12:14:21.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.183+0000 7fe601663700 1 -- 172.21.15.160:0/2049902415 learned_addr learned my addr 172.21.15.160:0/2049902415 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:21.193 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe601663700 1 -- 172.21.15.160:0/2049902415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5fc0bb3e0 msgr2=0x7fe5fc163d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.193 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe601663700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5fc0bb3e0 0x7fe5fc163d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.193 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe601663700 1 -- 172.21.15.160:0/2049902415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5fc0bfa20 msgr2=0x7fe5fc0c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.193 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe601663700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5fc0bfa20 0x7fe5fc0c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.193 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe601663700 1 -- 172.21.15.160:0/2049902415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc14ffc0 con 0x7fe5fc065330 2020-11-20T12:14:21.194 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe601663700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc150890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe5f800ebd0 tx=0x7fe5f8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.194 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800b8a0 con 0x7fe5fc065330 2020-11-20T12:14:21.194 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800ba00 con 0x7fe5fc065330 2020-11-20T12:14:21.194 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc150260 con 0x7fe5fc065330 2020-11-20T12:14:21.194 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800bd80 con 0x7fe5fc065330 2020-11-20T12:14:21.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.184+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc1641f0 con 0x7fe5fc065330 2020-11-20T12:14:21.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.185+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5fc044f60 con 0x7fe5fc065330 2020-11-20T12:14:21.196 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.187+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe5f8012600 con 0x7fe5fc065330 2020-11-20T12:14:21.196 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.188+0000 7fe5e97fa700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe5d4080630 0x7fe5d4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.188+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fe5f80a3650 con 0x7fe5fc065330 2020-11-20T12:14:21.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.188+0000 7fe600e62700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe5d4080630 0x7fe5d4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.188+0000 7fe5e97fa700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fe5d4088cd0 0x7fe5d408b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.188+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 --> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5d408b750 con 0x7fe5d4088cd0 2020-11-20T12:14:21.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.188+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5f80a3a50 con 0x7fe5fc065330 2020-11-20T12:14:21.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.188+0000 7fe601e64700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fe5d4088cd0 0x7fe5d408b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.189+0000 7fe600e62700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe5d4080630 0x7fe5d4082af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe5fc067690 tx=0x7fe5ec015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.189+0000 7fe601e64700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fe5d4088cd0 0x7fe5d408b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.199 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.190+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== osd.4 v2:172.21.15.150:6818/21785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fe5d408b750 con 0x7fe5d4088cd0 2020-11-20T12:14:21.210 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.206+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 --> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe5fc0c34e0 con 0x7fe5d4088cd0 2020-11-20T12:14:21.211 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.207+0000 7fe5e97fa700 1 -- 172.21.15.160:0/2049902415 <== osd.4 v2:172.21.15.150:6818/21785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe5fc0c34e0 con 0x7fe5d4088cd0 2020-11-20T12:14:21.212 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fe5d4088cd0 msgr2=0x7fe5d408b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.212 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fe5d4088cd0 0x7fe5d408b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.212 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe5d4080630 msgr2=0x7fe5d4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.212 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe5d4080630 0x7fe5d4082af0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fe5fc067690 tx=0x7fe5ec015000).stop 2020-11-20T12:14:21.213 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 msgr2=0x7fe5fc150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.213 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 --2- 172.21.15.160:0/2049902415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe5fc065330 0x7fe5fc150890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe5f800ebd0 tx=0x7fe5f8006df0).stop 2020-11-20T12:14:21.213 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe601e64700 1 -- 172.21.15.160:0/2049902415 reap_dead start 2020-11-20T12:14:21.213 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 shutdown_connections 2020-11-20T12:14:21.214 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 >> 172.21.15.160:0/2049902415 conn(0x7fe5fc062ef0 msgr2=0x7fe5fc14b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.214 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 shutdown_connections 2020-11-20T12:14:21.214 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.208+0000 7fe602665700 1 -- 172.21.15.160:0/2049902415 wait complete. 2020-11-20T12:14:21.233 INFO:teuthology.orchestra.run.smithi160.stdout:73014444040 2020-11-20T12:14:21.234 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-20T12:14:21.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.483+0000 7f4dd759e700 1 Processor -- start 2020-11-20T12:14:21.487 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.483+0000 7f4dd759e700 1 -- start start 2020-11-20T12:14:21.488 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.485+0000 7f4dd759e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4dd80ba510 0x7f4dd80ba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.485+0000 7f4dd759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4dd8151a90 0x7f4dd80bc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.485+0000 7f4dd759e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd814da40 con 0x7f4dd80bc520 2020-11-20T12:14:21.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.485+0000 7f4dd759e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd814dce0 con 0x7f4dd80ba510 2020-11-20T12:14:21.489 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.485+0000 7f4dd759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd814df80 con 0x7f4dd8151a90 2020-11-20T12:14:21.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd5d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4dd8151a90 0x7f4dd80bc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd6d9d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f4dd80bc520 0x7f4dd814f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55570/0 (socket says 172.21.15.160:55570) 2020-11-20T12:14:21.491 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd5d9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f4dd8151a90 0x7f4dd80bc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51126/0 (socket says 172.21.15.160:51126) 2020-11-20T12:14:21.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd6d9d700 1 -- 172.21.15.160:0/3943944748 learned_addr learned my addr 172.21.15.160:0/3943944748 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:21.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd659c700 1 --2- 172.21.15.160:0/3943944748 >> v2:172.21.15.134:3300/0 conn(0x7f4dd80ba510 0x7f4dd80ba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd5d9b700 1 -- 172.21.15.160:0/3943944748 >> v2:172.21.15.134:3300/0 conn(0x7f4dd80ba510 msgr2=0x7f4dd80ba8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:21.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd5d9b700 1 --2- 172.21.15.160:0/3943944748 >> v2:172.21.15.134:3300/0 conn(0x7f4dd80ba510 0x7f4dd80ba8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.492 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd5d9b700 1 -- 172.21.15.160:0/3943944748 >> v1:172.21.15.160:6789/0 conn(0x7f4dd80bc520 legacy=0x7f4dd814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd559a700 1 -- 172.21.15.160:0/3943944748 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288895913 0 0) 0x7f4dd814da40 con 0x7f4dd80bc520 2020-11-20T12:14:21.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.486+0000 7f4dd5d9b700 1 -- 172.21.15.160:0/3943944748 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd814e220 con 0x7f4dd8151a90 2020-11-20T12:14:21.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.487+0000 7f4dd5d9b700 1 --2- 172.21.15.160:0/3943944748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 0x7f4dd80bc030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4dd80bade0 tx=0x7f4dcc006df0).ready entity=mon.1 client_cookie=35e60368483c304b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.487+0000 7f4dd559a700 1 -- 172.21.15.160:0/3943944748 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc009840 con 0x7f4dd8151a90 2020-11-20T12:14:21.493 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.487+0000 7f4dd559a700 1 -- 172.21.15.160:0/3943944748 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0099a0 con 0x7f4dd8151a90 2020-11-20T12:14:21.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.487+0000 7f4dd559a700 1 -- 172.21.15.160:0/3943944748 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc009d20 con 0x7f4dd8151a90 2020-11-20T12:14:21.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.487+0000 7f4dd759e700 1 -- 172.21.15.160:0/3943944748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 msgr2=0x7f4dd80bc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.488+0000 7f4dd759e700 1 --2- 172.21.15.160:0/3943944748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 0x7f4dd80bc030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f4dd80bade0 tx=0x7f4dcc006df0).stop 2020-11-20T12:14:21.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.488+0000 7f4dd759e700 1 -- 172.21.15.160:0/3943944748 shutdown_connections 2020-11-20T12:14:21.494 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.488+0000 7f4dd759e700 1 --2- 172.21.15.160:0/3943944748 >> v2:172.21.15.134:3300/0 conn(0x7f4dd80ba510 0x7f4dd80ba8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.495 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.488+0000 7f4dd759e700 1 --2- 172.21.15.160:0/3943944748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 0x7f4dd80bc030 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.495 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.488+0000 7f4dd759e700 1 -- 172.21.15.160:0/3943944748 >> 172.21.15.160:0/3943944748 conn(0x7f4dd8062ef0 msgr2=0x7f4dd8063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.488+0000 7f4dd759e700 1 -- 172.21.15.160:0/3943944748 shutdown_connections 2020-11-20T12:14:21.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.488+0000 7f4dd759e700 1 -- 172.21.15.160:0/3943944748 wait complete. 2020-11-20T12:14:21.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.489+0000 7f4dd759e700 1 Processor -- start 2020-11-20T12:14:21.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.490+0000 7f4dd759e700 1 -- start start 2020-11-20T12:14:21.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd80ba510 0x7f4dd8143cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd759e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd80bc520 0x7f4dd81451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 0x7f4dd81456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd759e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8164190 con 0x7f4dd80bc520 2020-11-20T12:14:21.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd8160120 con 0x7f4dd8151a90 2020-11-20T12:14:21.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd759e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd81603c0 con 0x7f4dd80ba510 2020-11-20T12:14:21.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd80ba510 0x7f4dd8143cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd6d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 0x7f4dd81456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd5d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd80bc520 0x7f4dd81451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd80ba510 0x7f4dd8143cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:37996/0 (socket says 172.21.15.160:37996) 2020-11-20T12:14:21.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd659c700 1 -- 172.21.15.160:0/20460881 learned_addr learned my addr 172.21.15.160:0/20460881 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:21.501 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd659c700 1 -- 172.21.15.160:0/20460881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 msgr2=0x7f4dd81456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd659c700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd8151a90 0x7f4dd81456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd659c700 1 -- 172.21.15.160:0/20460881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd80bc520 msgr2=0x7f4dd81451e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.491+0000 7f4dd659c700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4dd80bc520 0x7f4dd81451e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.492+0000 7f4dd659c700 1 -- 172.21.15.160:0/20460881 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8160660 con 0x7f4dd80ba510 2020-11-20T12:14:21.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.492+0000 7f4dd659c700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd80ba510 0x7f4dd8143cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4dc800db60 tx=0x7f4dc8008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.492+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800be30 con 0x7f4dd80ba510 2020-11-20T12:14:21.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.492+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc8009790 con 0x7f4dd80ba510 2020-11-20T12:14:21.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.492+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8009b30 con 0x7f4dd80ba510 2020-11-20T12:14:21.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.492+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd8160900 con 0x7f4dd80ba510 2020-11-20T12:14:21.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.492+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd80c0e10 con 0x7f4dd80ba510 2020-11-20T12:14:21.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.493+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4dd8044f60 con 0x7f4dd80ba510 2020-11-20T12:14:21.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.494+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4dc8013480 con 0x7f4dd80ba510 2020-11-20T12:14:21.506 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.495+0000 7f4dc67fc700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4dac080630 0x7f4dac082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.506 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.495+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f4dc80a38e0 con 0x7f4dd80ba510 2020-11-20T12:14:21.506 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.496+0000 7f4dd5d9b700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4dac080630 0x7f4dac082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.506 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.496+0000 7f4dc67fc700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7f4dac088cd0 0x7f4dac08b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.496+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 --> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4dac08b750 con 0x7f4dac088cd0 2020-11-20T12:14:21.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.496+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dc80a3bd0 con 0x7f4dd80ba510 2020-11-20T12:14:21.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.496+0000 7f4dd5d9b700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4dac080630 0x7f4dac082af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4dcc00c010 tx=0x7f4dcc015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.496+0000 7f4dd6d9d700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7f4dac088cd0 0x7f4dac08b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.497+0000 7f4dd6d9d700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7f4dac088cd0 0x7f4dac08b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.508 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.498+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== osd.5 v2:172.21.15.134:6816/22195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f4dac08b750 con 0x7f4dac088cd0 2020-11-20T12:14:21.518 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.514+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 --> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4dd81441c0 con 0x7f4dac088cd0 2020-11-20T12:14:21.518 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.515+0000 7f4dc67fc700 1 -- 172.21.15.160:0/20460881 <== osd.5 v2:172.21.15.134:6816/22195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4dd81441c0 con 0x7f4dac088cd0 2020-11-20T12:14:21.519 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7f4dac088cd0 msgr2=0x7f4dac08b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.519 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7f4dac088cd0 0x7f4dac08b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.520 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4dac080630 msgr2=0x7f4dac082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.520 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4dac080630 0x7f4dac082af0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f4dcc00c010 tx=0x7f4dcc015000).stop 2020-11-20T12:14:21.520 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd80ba510 msgr2=0x7f4dd8143cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.520 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 --2- 172.21.15.160:0/20460881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4dd80ba510 0x7f4dd8143cd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4dc800db60 tx=0x7f4dc8008040).stop 2020-11-20T12:14:21.521 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd6d9d700 1 -- 172.21.15.160:0/20460881 reap_dead start 2020-11-20T12:14:21.521 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 shutdown_connections 2020-11-20T12:14:21.521 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 >> 172.21.15.160:0/20460881 conn(0x7f4dd8062ef0 msgr2=0x7f4dd814a730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.521 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 shutdown_connections 2020-11-20T12:14:21.521 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.516+0000 7f4dd759e700 1 -- 172.21.15.160:0/20460881 wait complete. 2020-11-20T12:14:21.542 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:21.543 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-20T12:14:21.794 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.789+0000 7f588a2de700 1 Processor -- start 2020-11-20T12:14:21.794 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.789+0000 7f588a2de700 1 -- start start 2020-11-20T12:14:21.795 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f588a2de700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58840bc720 0x7f58840bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.795 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f588a2de700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5884065200 0x7f58840bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.795 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f588a2de700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58840bfbc0 con 0x7f588414f590 2020-11-20T12:14:21.797 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f588a2de700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5884065eb0 con 0x7f58840bc720 2020-11-20T12:14:21.797 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f588a2de700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588414ebf0 con 0x7f5884065200 2020-11-20T12:14:21.797 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f5889add700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5884065200 0x7f58840bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.798 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f5888adb700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f588414f590 0x7f58840bf4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60318/0 (socket says 172.21.15.160:60318) 2020-11-20T12:14:21.798 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f58892dc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f58840bc720 0x7f58840bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.798 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.791+0000 7f5888adb700 1 -- 172.21.15.160:0/2331243421 learned_addr learned my addr 172.21.15.160:0/2331243421 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:21.798 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.792+0000 7f5873fff700 1 -- 172.21.15.160:0/2331243421 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848724158 0 0) 0x7f58840bfbc0 con 0x7f588414f590 2020-11-20T12:14:21.798 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.792+0000 7f5873fff700 1 -- 172.21.15.160:0/2331243421 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f586c003240 con 0x7f588414f590 2020-11-20T12:14:21.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.792+0000 7f58892dc700 1 -- 172.21.15.160:0/2331243421 >> v2:172.21.15.150:3300/0 conn(0x7f5884065200 msgr2=0x7f58840bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:21.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.792+0000 7f58892dc700 1 --2- 172.21.15.160:0/2331243421 >> v2:172.21.15.150:3300/0 conn(0x7f5884065200 0x7f58840bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.792+0000 7f58892dc700 1 -- 172.21.15.160:0/2331243421 >> v1:172.21.15.134:6789/0 conn(0x7f588414f590 legacy=0x7f58840bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.792+0000 7f58892dc700 1 -- 172.21.15.160:0/2331243421 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588414f9f0 con 0x7f58840bc720 2020-11-20T12:14:21.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.792+0000 7f58892dc700 1 --2- 172.21.15.160:0/2331243421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58840bc720 0x7f58840bcb00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f58840bf1d0 tx=0x7f58800091d0).ready entity=mon.0 client_cookie=3bd9feccda674ef3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.793+0000 7f5873fff700 1 -- 172.21.15.160:0/2331243421 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588000ba20 con 0x7f58840bc720 2020-11-20T12:14:21.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.793+0000 7f5873fff700 1 -- 172.21.15.160:0/2331243421 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588000bb80 con 0x7f58840bc720 2020-11-20T12:14:21.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.793+0000 7f5873fff700 1 -- 172.21.15.160:0/2331243421 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880011400 con 0x7f58840bc720 2020-11-20T12:14:21.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.793+0000 7f588a2de700 1 -- 172.21.15.160:0/2331243421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58840bc720 msgr2=0x7f58840bcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.793+0000 7f588a2de700 1 --2- 172.21.15.160:0/2331243421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58840bc720 0x7f58840bcb00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f58840bf1d0 tx=0x7f58800091d0).stop 2020-11-20T12:14:21.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.794+0000 7f588a2de700 1 -- 172.21.15.160:0/2331243421 shutdown_connections 2020-11-20T12:14:21.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.794+0000 7f588a2de700 1 --2- 172.21.15.160:0/2331243421 >> v2:172.21.15.150:3300/0 conn(0x7f5884065200 0x7f58840bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.794+0000 7f588a2de700 1 --2- 172.21.15.160:0/2331243421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58840bc720 0x7f58840bcb00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.794+0000 7f588a2de700 1 -- 172.21.15.160:0/2331243421 >> 172.21.15.160:0/2331243421 conn(0x7f5884062ef0 msgr2=0x7f5884063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.802 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.794+0000 7f588a2de700 1 -- 172.21.15.160:0/2331243421 shutdown_connections 2020-11-20T12:14:21.802 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.794+0000 7f588a2de700 1 -- 172.21.15.160:0/2331243421 wait complete. 2020-11-20T12:14:21.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.795+0000 7f588a2de700 1 Processor -- start 2020-11-20T12:14:21.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.796+0000 7f588a2de700 1 -- start start 2020-11-20T12:14:21.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.796+0000 7f588a2de700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5884065200 0x7f588414aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.796+0000 7f588a2de700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58840bc720 0x7f5884154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.796+0000 7f588a2de700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588414f590 0x7f5884152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.796+0000 7f588a2de700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884112520 con 0x7f5884065200 2020-11-20T12:14:21.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.796+0000 7f588a2de700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588414af20 con 0x7f58840bc720 2020-11-20T12:14:21.806 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.796+0000 7f588a2de700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884111fe0 con 0x7f588414f590 2020-11-20T12:14:21.807 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5884065200 0x7f588414aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.807 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5884065200 0x7f588414aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60534/0 (socket says 172.21.15.160:60534) 2020-11-20T12:14:21.807 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 -- 172.21.15.160:0/1993075167 learned_addr learned my addr 172.21.15.160:0/1993075167 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:21.807 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f5888adb700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58840bc720 0x7f5884154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f5889add700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588414f590 0x7f5884152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 -- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588414f590 msgr2=0x7f5884152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588414f590 0x7f5884152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 -- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58840bc720 msgr2=0x7f5884154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f58840bc720 0x7f5884154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.797+0000 7f58892dc700 1 -- 172.21.15.160:0/1993075167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5884112280 con 0x7f5884065200 2020-11-20T12:14:21.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.798+0000 7f58892dc700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5884065200 0x7f588414aa30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f588000c000 tx=0x7f5880016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.798+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588001d480 con 0x7f5884065200 2020-11-20T12:14:21.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.798+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588001d5e0 con 0x7f5884065200 2020-11-20T12:14:21.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.798+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588414a050 con 0x7f5884065200 2020-11-20T12:14:21.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.798+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588001d960 con 0x7f5884065200 2020-11-20T12:14:21.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.798+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588414a590 con 0x7f5884065200 2020-11-20T12:14:21.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.799+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5884044f60 con 0x7f5884065200 2020-11-20T12:14:21.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.800+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f588002e070 con 0x7f5884065200 2020-11-20T12:14:21.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.801+0000 7f58717fa700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f585c080630 0x7f585c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.802+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f58800a4e00 con 0x7f5884065200 2020-11-20T12:14:21.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.802+0000 7f5888adb700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f585c080630 0x7f585c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.802+0000 7f58717fa700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7f585c088cd0 0x7f585c08b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.802+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 --> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f585c08b750 con 0x7f585c088cd0 2020-11-20T12:14:21.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.802+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58800a50f0 con 0x7f5884065200 2020-11-20T12:14:21.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.802+0000 7f5889add700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7f585c088cd0 0x7f585c08b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.802+0000 7f5888adb700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f585c080630 0x7f585c082af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5884153cd0 tx=0x7f5874009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.814 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.803+0000 7f5889add700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7f585c088cd0 0x7f585c08b0f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.814 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.804+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== osd.6 v2:172.21.15.160:6816/17072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f585c08b750 con 0x7f585c088cd0 2020-11-20T12:14:21.824 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.820+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 --> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5884064530 con 0x7f585c088cd0 2020-11-20T12:14:21.825 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.821+0000 7f58717fa700 1 -- 172.21.15.160:0/1993075167 <== osd.6 v2:172.21.15.160:6816/17072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5884064530 con 0x7f585c088cd0 2020-11-20T12:14:21.825 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.821+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7f585c088cd0 msgr2=0x7f585c08b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.821+0000 7f588a2de700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7f585c088cd0 0x7f585c08b0f0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f585c080630 msgr2=0x7f585c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f585c080630 0x7f585c082af0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5884153cd0 tx=0x7f5874009040).stop 2020-11-20T12:14:21.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5884065200 msgr2=0x7f588414aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.826 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 --2- 172.21.15.160:0/1993075167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5884065200 0x7f588414aa30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f588000c000 tx=0x7f5880016000).stop 2020-11-20T12:14:21.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f5889add700 1 -- 172.21.15.160:0/1993075167 reap_dead start 2020-11-20T12:14:21.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 shutdown_connections 2020-11-20T12:14:21.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 >> 172.21.15.160:0/1993075167 conn(0x7f5884062ef0 msgr2=0x7f58840c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 shutdown_connections 2020-11-20T12:14:21.827 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:21.822+0000 7f588a2de700 1 -- 172.21.15.160:0/1993075167 wait complete. 2020-11-20T12:14:21.848 INFO:teuthology.orchestra.run.smithi160.stdout:73014444038 2020-11-20T12:14:21.848 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-20T12:14:22.086 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.082+0000 7fcbbf31f700 1 Processor -- start 2020-11-20T12:14:22.086 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.082+0000 7fcbbf31f700 1 -- start start 2020-11-20T12:14:22.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.084+0000 7fcbbf31f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcbb8061c50 0x7fcbb8151070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.084+0000 7fcbbf31f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb80bbe80 con 0x7fcbb8064960 2020-11-20T12:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.084+0000 7fcbbf31f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb8151560 con 0x7fcbb8061870 2020-11-20T12:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.084+0000 7fcbbf31f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb80bd380 con 0x7fcbb8061c50 2020-11-20T12:14:22.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.084+0000 7fcbbdb1c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fcbb8061c50 0x7fcbb8151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.084+0000 7fcbbe31d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fcbb8061870 0x7fcbb80bb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55602/0 (socket says 172.21.15.160:55602) 2020-11-20T12:14:22.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.084+0000 7fcbbe31d700 1 -- 172.21.15.160:0/3500588056 learned_addr learned my addr 172.21.15.160:0/3500588056 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:22.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.085+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018622033 0 0) 0x7fcbb80bbe80 con 0x7fcbb8064960 2020-11-20T12:14:22.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.085+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba0003240 con 0x7fcbb8064960 2020-11-20T12:14:22.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.085+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696332445 0 0) 0x7fcbb8151560 con 0x7fcbb8061870 2020-11-20T12:14:22.092 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.085+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb80bbe80 con 0x7fcbb8061870 2020-11-20T12:14:22.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.085+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3900332649 0 0) 0x7fcba0003240 con 0x7fcbb8064960 2020-11-20T12:14:22.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.085+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 >> v2:172.21.15.160:3300/0 conn(0x7fcbb8061c50 msgr2=0x7fcbb8151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.085+0000 7fcbbd31b700 1 --2- 172.21.15.160:0/3500588056 >> v2:172.21.15.160:3300/0 conn(0x7fcbb8061c50 0x7fcbb8151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.093 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 >> v1:172.21.15.160:6789/0 conn(0x7fcbb8061870 legacy=0x7fcbb80bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb80bc0d0 con 0x7fcbb8064960 2020-11-20T12:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7fcbb0001860 con 0x7fcbb8064960 2020-11-20T12:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 >> v1:172.21.15.150:6789/0 conn(0x7fcbb8064960 legacy=0x7fcbb814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba0004970 0x7fcba0004d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.094 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcba0003900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcba0003df0 0x7fcba000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80bd380 con 0x7fcba0004970 2020-11-20T12:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba000bc20 con 0x7fcba0003480 2020-11-20T12:14:22.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba000bd60 con 0x7fcba0003df0 2020-11-20T12:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbeb1e700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcba0003df0 0x7fcba000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbdb1c700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcba0003900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.086+0000 7fcbbe31d700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba0004970 0x7fcba0004d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbdb1c700 1 -- 172.21.15.160:0/3500588056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcba0003df0 msgr2=0x7fcba000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbdb1c700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcba0003df0 0x7fcba000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbdb1c700 1 -- 172.21.15.160:0/3500588056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba0004970 msgr2=0x7fcba0004d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbdb1c700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcba0004970 0x7fcba0004d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbdb1c700 1 -- 172.21.15.160:0/3500588056 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba0003240 con 0x7fcba0003480 2020-11-20T12:14:22.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbeb1e700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcba0003df0 0x7fcba000b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:22.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbeb1e700 1 -- 172.21.15.160:0/3500588056 reap_dead start 2020-11-20T12:14:22.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.087+0000 7fcbbdb1c700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcba0003900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcba800bc00 tx=0x7fcba8006df0).ready entity=mon.1 client_cookie=bdbc8765d1cb254c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba800b310 con 0x7fcba0003480 2020-11-20T12:14:22.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba800ea30 con 0x7fcba0003480 2020-11-20T12:14:22.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbd31b700 1 -- 172.21.15.160:0/3500588056 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba800edb0 con 0x7fcba0003480 2020-11-20T12:14:22.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbf31f700 1 -- 172.21.15.160:0/3500588056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 msgr2=0x7fcba0003900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbf31f700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcba0003900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fcba800bc00 tx=0x7fcba8006df0).stop 2020-11-20T12:14:22.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbf31f700 1 -- 172.21.15.160:0/3500588056 shutdown_connections 2020-11-20T12:14:22.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbf31f700 1 --2- 172.21.15.160:0/3500588056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcba0003900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.088+0000 7fcbbf31f700 1 -- 172.21.15.160:0/3500588056 >> 172.21.15.160:0/3500588056 conn(0x7fcbb8062ef0 msgr2=0x7fcbb8063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:22.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.089+0000 7fcbbf31f700 1 -- 172.21.15.160:0/3500588056 shutdown_connections 2020-11-20T12:14:22.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.089+0000 7fcbbf31f700 1 -- 172.21.15.160:0/3500588056 wait complete. 2020-11-20T12:14:22.104 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.091+0000 7fcbbf31f700 1 Processor -- start 2020-11-20T12:14:22.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.091+0000 7fcbbf31f700 1 -- start start 2020-11-20T12:14:22.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbf31f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcbb8134970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbf31f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb81366b0 0x7fcbb814b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbf31f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb8161f30 0x7fcbb8164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbf31f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80c30a0 con 0x7fcbb8161f30 2020-11-20T12:14:22.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbf31f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb80c3340 con 0x7fcba0003480 2020-11-20T12:14:22.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbf31f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb8133f90 con 0x7fcbb81366b0 2020-11-20T12:14:22.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbdb1c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb81366b0 0x7fcbb814b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbe31d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcbb8134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbe31d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcbb8134970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51170/0 (socket says 172.21.15.160:51170) 2020-11-20T12:14:22.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.092+0000 7fcbbe31d700 1 -- 172.21.15.160:0/4126706288 learned_addr learned my addr 172.21.15.160:0/4126706288 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:22.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbeb1e700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb8161f30 0x7fcbb8164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbe31d700 1 -- 172.21.15.160:0/4126706288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb81366b0 msgr2=0x7fcbb814b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbe31d700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcbb81366b0 0x7fcbb814b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbe31d700 1 -- 172.21.15.160:0/4126706288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb8161f30 msgr2=0x7fcbb8164030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbe31d700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb8161f30 0x7fcbb8164030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbe31d700 1 -- 172.21.15.160:0/4126706288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb8134230 con 0x7fcba0003480 2020-11-20T12:14:22.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbeb1e700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb8161f30 0x7fcbb8164030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:22.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbe31d700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcbb8134970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fcbb40018f0 tx=0x7fcbb4007c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400f720 con 0x7fcba0003480 2020-11-20T12:14:22.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb400f880 con 0x7fcba0003480 2020-11-20T12:14:22.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400fc20 con 0x7fcba0003480 2020-11-20T12:14:22.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.093+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb81344d0 con 0x7fcba0003480 2020-11-20T12:14:22.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.094+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb80c35e0 con 0x7fcba0003480 2020-11-20T12:14:22.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.094+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcbb814e560 con 0x7fcba0003480 2020-11-20T12:14:22.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.096+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcbb401b030 con 0x7fcba0003480 2020-11-20T12:14:22.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.097+0000 7fcba67fc700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcb90080630 0x7fcb90082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.097+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fcbb40a2910 con 0x7fcba0003480 2020-11-20T12:14:22.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.097+0000 7fcbbdb1c700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcb90080630 0x7fcb90082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.097+0000 7fcba67fc700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7fcb90088cd0 0x7fcb9008b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.097+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 --> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb9008b750 con 0x7fcb90088cd0 2020-11-20T12:14:22.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.097+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbb40a2d10 con 0x7fcba0003480 2020-11-20T12:14:22.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.098+0000 7fcbbeb1e700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7fcb90088cd0 0x7fcb9008b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.098+0000 7fcbbdb1c700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcb90080630 0x7fcb90082af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcbb81351b0 tx=0x7fcba8019000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.113 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.098+0000 7fcbbeb1e700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7fcb90088cd0 0x7fcb9008b0f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.113 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.099+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== osd.7 v2:172.21.15.150:6824/21826 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fcb9008b750 con 0x7fcb90088cd0 2020-11-20T12:14:22.119 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.116+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 --> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcbb8044f60 con 0x7fcb90088cd0 2020-11-20T12:14:22.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.117+0000 7fcba67fc700 1 -- 172.21.15.160:0/4126706288 <== osd.7 v2:172.21.15.150:6824/21826 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcbb8044f60 con 0x7fcb90088cd0 2020-11-20T12:14:22.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.117+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7fcb90088cd0 msgr2=0x7fcb9008b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.117+0000 7fcbbf31f700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7fcb90088cd0 0x7fcb9008b0f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.117+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcb90080630 msgr2=0x7fcb90082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.117+0000 7fcbbf31f700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fcb90080630 0x7fcb90082af0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fcbb81351b0 tx=0x7fcba8019000).stop 2020-11-20T12:14:22.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.117+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 msgr2=0x7fcbb8134970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.117+0000 7fcbbf31f700 1 --2- 172.21.15.160:0/4126706288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcba0003480 0x7fcbb8134970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fcbb40018f0 tx=0x7fcbb4007c80).stop 2020-11-20T12:14:22.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.118+0000 7fcbbeb1e700 1 -- 172.21.15.160:0/4126706288 reap_dead start 2020-11-20T12:14:22.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.118+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 shutdown_connections 2020-11-20T12:14:22.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.118+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 >> 172.21.15.160:0/4126706288 conn(0x7fcbb8062ef0 msgr2=0x7fcbb814de50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:22.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.118+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 shutdown_connections 2020-11-20T12:14:22.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.118+0000 7fcbbf31f700 1 -- 172.21.15.160:0/4126706288 wait complete. 2020-11-20T12:14:22.144 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:22.145 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2020-11-20T12:14:22.386 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.383+0000 7f8d90b92700 1 Processor -- start 2020-11-20T12:14:22.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.383+0000 7f8d90b92700 1 -- start start 2020-11-20T12:14:22.388 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d90b92700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f8d8c0bc720 0x7f8d8c0bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.388 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d90b92700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8d8c065200 0x7f8d8c0bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d90b92700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c0bfbc0 con 0x7f8d8c14f590 2020-11-20T12:14:22.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d90b92700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c065eb0 con 0x7f8d8c0bc720 2020-11-20T12:14:22.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d90b92700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c14ebf0 con 0x7f8d8c065200 2020-11-20T12:14:22.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d8affd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f8d8c14f590 0x7f8d8c0bf4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46890/0 (socket says 172.21.15.160:46890) 2020-11-20T12:14:22.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d8affd700 1 -- 172.21.15.160:0/2907710807 learned_addr learned my addr 172.21.15.160:0/2907710807 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:22.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d8bfff700 1 --2- 172.21.15.160:0/2907710807 >> v2:172.21.15.160:3300/0 conn(0x7f8d8c065200 0x7f8d8c0bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.385+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/2907710807 >> v2:172.21.15.134:3300/0 conn(0x7f8d8c0bc720 0x7f8d8c0bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709182269 0 0) 0x7f8d8c0bfbc0 con 0x7f8d8c14f590 2020-11-20T12:14:22.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d78003240 con 0x7f8d8c14f590 2020-11-20T12:14:22.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2913281593 0 0) 0x7f8d78003240 con 0x7f8d8c14f590 2020-11-20T12:14:22.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 >> v2:172.21.15.160:3300/0 conn(0x7f8d8c065200 msgr2=0x7f8d8c0bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 --2- 172.21.15.160:0/2907710807 >> v2:172.21.15.160:3300/0 conn(0x7f8d8c065200 0x7f8d8c0bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 >> v2:172.21.15.134:3300/0 conn(0x7f8d8c0bc720 msgr2=0x7f8d8c0bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 --2- 172.21.15.160:0/2907710807 >> v2:172.21.15.134:3300/0 conn(0x7f8d8c0bc720 0x7f8d8c0bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c14f9f0 con 0x7f8d8c14f590 2020-11-20T12:14:22.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f8d800014e0 con 0x7f8d8c14f590 2020-11-20T12:14:22.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 >> v1:172.21.15.150:6789/0 conn(0x7f8d8c14f590 legacy=0x7f8d8c0bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d78003780 0x7f8d78003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d780044e0 0x7f8d78004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d78004e50 0x7f8d7800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c065eb0 con 0x7f8d780044e0 2020-11-20T12:14:22.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c14ebf0 con 0x7f8d78003780 2020-11-20T12:14:22.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.386+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d78005300 con 0x7f8d78004e50 2020-11-20T12:14:22.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d78003780 0x7f8d78003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8affd700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d780044e0 0x7f8d78004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8bfff700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d78004e50 0x7f8d7800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8b7fe700 1 -- 172.21.15.160:0/2907710807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d78004e50 msgr2=0x7f8d7800b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d78004e50 0x7f8d7800b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8b7fe700 1 -- 172.21.15.160:0/2907710807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d780044e0 msgr2=0x7f8d78004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d780044e0 0x7f8d78004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8b7fe700 1 -- 172.21.15.160:0/2907710807 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78003240 con 0x7f8d78003780 2020-11-20T12:14:22.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8affd700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d780044e0 0x7f8d78004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:22.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8bfff700 1 -- 172.21.15.160:0/2907710807 reap_dead start 2020-11-20T12:14:22.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.387+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d78003780 0x7f8d78003ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f8d7c00bc00 tx=0x7f8d7c006df0).ready entity=mon.1 client_cookie=b0b9808f826b5a72 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00b310 con 0x7f8d78003780 2020-11-20T12:14:22.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c00ea30 con 0x7f8d78003780 2020-11-20T12:14:22.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d8a7fc700 1 -- 172.21.15.160:0/2907710807 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00edb0 con 0x7f8d78003780 2020-11-20T12:14:22.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d90b92700 1 -- 172.21.15.160:0/2907710807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d78003780 msgr2=0x7f8d78003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d90b92700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d78003780 0x7f8d78003ba0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f8d7c00bc00 tx=0x7f8d7c006df0).stop 2020-11-20T12:14:22.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d90b92700 1 -- 172.21.15.160:0/2907710807 shutdown_connections 2020-11-20T12:14:22.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d90b92700 1 --2- 172.21.15.160:0/2907710807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d78003780 0x7f8d78003ba0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.388+0000 7f8d90b92700 1 -- 172.21.15.160:0/2907710807 >> 172.21.15.160:0/2907710807 conn(0x7f8d8c062ef0 msgr2=0x7f8d8c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:22.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.389+0000 7f8d90b92700 1 -- 172.21.15.160:0/2907710807 shutdown_connections 2020-11-20T12:14:22.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.389+0000 7f8d90b92700 1 -- 172.21.15.160:0/2907710807 wait complete. 2020-11-20T12:14:22.406 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.390+0000 7f8d90b92700 1 Processor -- start 2020-11-20T12:14:22.406 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.390+0000 7f8d90b92700 1 -- start start 2020-11-20T12:14:22.407 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d90b92700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d78003780 0x7f8d8c10e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.407 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d90b92700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d8c152f70 0x7f8d8c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.407 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d90b92700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d8c153d20 0x7f8d8c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.407 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d90b92700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c10f030 con 0x7f8d78003780 2020-11-20T12:14:22.407 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d90b92700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c10ed90 con 0x7f8d8c153d20 2020-11-20T12:14:22.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d90b92700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c151260 con 0x7f8d8c152f70 2020-11-20T12:14:22.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d8affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d8c152f70 0x7f8d8c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.391+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d8c153d20 0x7f8d8c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d8c152f70 0x7f8d8c153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38058/0 (socket says 172.21.15.160:38058) 2020-11-20T12:14:22.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d8c153d20 0x7f8d8c0c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51196/0 (socket says 172.21.15.160:51196) 2020-11-20T12:14:22.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8affd700 1 -- 172.21.15.160:0/1898327925 learned_addr learned my addr 172.21.15.160:0/1898327925 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:22.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d78003780 0x7f8d8c10e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8bfff700 1 -- 172.21.15.160:0/1898327925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d8c152f70 msgr2=0x7f8d8c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8bfff700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d8c152f70 0x7f8d8c153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8bfff700 1 -- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d78003780 msgr2=0x7f8d8c10e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8bfff700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d78003780 0x7f8d8c10e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8bfff700 1 -- 172.21.15.160:0/1898327925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c151500 con 0x7f8d8c153d20 2020-11-20T12:14:22.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8affd700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d8c152f70 0x7f8d8c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:22.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d8bfff700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d8c153d20 0x7f8d8c0c0e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8d8c061060 tx=0x7f8d840091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.392+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400fa40 con 0x7f8d8c153d20 2020-11-20T12:14:22.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.393+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8400fba0 con 0x7f8d8c153d20 2020-11-20T12:14:22.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.393+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d84014440 con 0x7f8d8c153d20 2020-11-20T12:14:22.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.393+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c1517a0 con 0x7f8d8c153d20 2020-11-20T12:14:22.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.393+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c151ee0 con 0x7f8d8c153d20 2020-11-20T12:14:22.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.393+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d8c044f60 con 0x7f8d8c153d20 2020-11-20T12:14:22.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.395+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8d84014870 con 0x7f8d8c153d20 2020-11-20T12:14:22.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.396+0000 7f8d6b7fe700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8d64080660 0x7f8d64082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.396+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f8d840a3cd0 con 0x7f8d8c153d20 2020-11-20T12:14:22.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.396+0000 7f8d6b7fe700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f8d64088d00 0x7f8d6408b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.396+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 --> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d6408b780 con 0x7f8d64088d00 2020-11-20T12:14:22.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.396+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d840a40d0 con 0x7f8d8c153d20 2020-11-20T12:14:22.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.396+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8d64080660 0x7f8d64082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.397+0000 7f8d8affd700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f8d64088d00 0x7f8d6408b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.397+0000 7f8d8b7fe700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8d64080660 0x7f8d64082b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8d7c006e30 tx=0x7f8d7c019000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.397+0000 7f8d8affd700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f8d64088d00 0x7f8d6408b120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.415 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.398+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== osd.8 v2:172.21.15.134:6808/22184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f8d6408b780 con 0x7f8d64088d00 2020-11-20T12:14:22.419 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.416+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 --> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d8c064530 con 0x7f8d64088d00 2020-11-20T12:14:22.420 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.416+0000 7f8d6b7fe700 1 -- 172.21.15.160:0/1898327925 <== osd.8 v2:172.21.15.134:6808/22184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d8c064530 con 0x7f8d64088d00 2020-11-20T12:14:22.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f8d64088d00 msgr2=0x7f8d6408b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f8d64088d00 0x7f8d6408b120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8d64080660 msgr2=0x7f8d64082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8d64080660 0x7f8d64082b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f8d7c006e30 tx=0x7f8d7c019000).stop 2020-11-20T12:14:22.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d8c153d20 msgr2=0x7f8d8c0c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 --2- 172.21.15.160:0/1898327925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d8c153d20 0x7f8d8c0c0e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8d8c061060 tx=0x7f8d840091d0).stop 2020-11-20T12:14:22.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d8bfff700 1 -- 172.21.15.160:0/1898327925 reap_dead start 2020-11-20T12:14:22.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 shutdown_connections 2020-11-20T12:14:22.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 >> 172.21.15.160:0/1898327925 conn(0x7f8d8c062ef0 msgr2=0x7f8d8c0c2190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:22.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 shutdown_connections 2020-11-20T12:14:22.423 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.417+0000 7f8d90b92700 1 -- 172.21.15.160:0/1898327925 wait complete. 2020-11-20T12:14:22.441 INFO:teuthology.orchestra.run.smithi160.stdout:73014444040 2020-11-20T12:14:22.442 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2020-11-20T12:14:22.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.679+0000 7ff2b886d700 1 Processor -- start 2020-11-20T12:14:22.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.680+0000 7ff2b886d700 1 -- start start 2020-11-20T12:14:22.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.681+0000 7ff2b886d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2b40bcb00 0x7ff2b414f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.681+0000 7ff2b886d700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2b4065200 0x7ff2b40bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.681+0000 7ff2b886d700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b40bfbc0 con 0x7ff2b40bc720 2020-11-20T12:14:22.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.681+0000 7ff2b886d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b4065eb0 con 0x7ff2b40bcb00 2020-11-20T12:14:22.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.681+0000 7ff2b886d700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b414ebf0 con 0x7ff2b4065200 2020-11-20T12:14:22.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2aaffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7ff2b40bcb00 0x7ff2b414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2b3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff2b4065200 0x7ff2b40bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2b37fe700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7ff2b40bc720 0x7ff2b40bf4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60376/0 (socket says 172.21.15.160:60376) 2020-11-20T12:14:22.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2b37fe700 1 -- 172.21.15.160:0/2300259026 learned_addr learned my addr 172.21.15.160:0/2300259026 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:22.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2aaffd700 1 -- 172.21.15.160:0/2300259026 >> v2:172.21.15.150:3300/0 conn(0x7ff2b4065200 msgr2=0x7ff2b40bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2aaffd700 1 --2- 172.21.15.160:0/2300259026 >> v2:172.21.15.150:3300/0 conn(0x7ff2b4065200 0x7ff2b40bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2aaffd700 1 -- 172.21.15.160:0/2300259026 >> v1:172.21.15.134:6789/0 conn(0x7ff2b40bc720 legacy=0x7ff2b40bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2aaffd700 1 -- 172.21.15.160:0/2300259026 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4065970 con 0x7ff2b40bcb00 2020-11-20T12:14:22.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2b2ffd700 1 -- 172.21.15.160:0/2300259026 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253277323 0 0) 0x7ff2b40bfbc0 con 0x7ff2b40bc720 2020-11-20T12:14:22.689 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.682+0000 7ff2aaffd700 1 --2- 172.21.15.160:0/2300259026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b40bcb00 0x7ff2b414f590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff2b40bf1d0 tx=0x7ff29c006df0).ready entity=mon.0 client_cookie=9a8be6654358f3e9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.689 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b2ffd700 1 -- 172.21.15.160:0/2300259026 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0097b0 con 0x7ff2b40bcb00 2020-11-20T12:14:22.689 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b2ffd700 1 -- 172.21.15.160:0/2300259026 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c009910 con 0x7ff2b40bcb00 2020-11-20T12:14:22.689 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b2ffd700 1 -- 172.21.15.160:0/2300259026 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c009c90 con 0x7ff2b40bcb00 2020-11-20T12:14:22.690 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 -- 172.21.15.160:0/2300259026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b40bcb00 msgr2=0x7ff2b414f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.690 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 --2- 172.21.15.160:0/2300259026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b40bcb00 0x7ff2b414f590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7ff2b40bf1d0 tx=0x7ff29c006df0).stop 2020-11-20T12:14:22.690 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 -- 172.21.15.160:0/2300259026 shutdown_connections 2020-11-20T12:14:22.690 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 --2- 172.21.15.160:0/2300259026 >> v2:172.21.15.150:3300/0 conn(0x7ff2b4065200 0x7ff2b40bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.690 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 --2- 172.21.15.160:0/2300259026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b40bcb00 0x7ff2b414f590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.691 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 -- 172.21.15.160:0/2300259026 >> 172.21.15.160:0/2300259026 conn(0x7ff2b4062ef0 msgr2=0x7ff2b4063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:22.691 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 -- 172.21.15.160:0/2300259026 shutdown_connections 2020-11-20T12:14:22.691 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.683+0000 7ff2b886d700 1 -- 172.21.15.160:0/2300259026 wait complete. 2020-11-20T12:14:22.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.685+0000 7ff2b886d700 1 Processor -- start 2020-11-20T12:14:22.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.685+0000 7ff2b886d700 1 -- start start 2020-11-20T12:14:22.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b886d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b4065200 0x7ff2b4111aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b886d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2b40bc720 0x7ff2b4151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b886d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b40bcb00 0x7ff2b4163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b886d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4154fa0 con 0x7ff2b4065200 2020-11-20T12:14:22.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b886d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4150660 con 0x7ff2b40bc720 2020-11-20T12:14:22.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b886d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4150900 con 0x7ff2b40bcb00 2020-11-20T12:14:22.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b4065200 0x7ff2b4111aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b4065200 0x7ff2b4111aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60594/0 (socket says 172.21.15.160:60594) 2020-11-20T12:14:22.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2b37fe700 1 -- 172.21.15.160:0/2589752209 learned_addr learned my addr 172.21.15.160:0/2589752209 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:22.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.686+0000 7ff2aaffd700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2b40bc720 0x7ff2b4151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2b3fff700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b40bcb00 0x7ff2b4163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2aaffd700 1 -- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b40bcb00 msgr2=0x7ff2b4163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2aaffd700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2b40bcb00 0x7ff2b4163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2aaffd700 1 -- 172.21.15.160:0/2589752209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b4065200 msgr2=0x7ff2b4111aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2aaffd700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b4065200 0x7ff2b4111aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2aaffd700 1 -- 172.21.15.160:0/2589752209 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4150ba0 con 0x7ff2b40bc720 2020-11-20T12:14:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2b37fe700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b4065200 0x7ff2b4111aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:22.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2aaffd700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2b40bc720 0x7ff2b4151ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff29c012000 tx=0x7ff29c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c011d50 con 0x7ff2b40bc720 2020-11-20T12:14:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c01e460 con 0x7ff2b40bc720 2020-11-20T12:14:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.687+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b4150e40 con 0x7ff2b40bc720 2020-11-20T12:14:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.688+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c01e7e0 con 0x7ff2b40bc720 2020-11-20T12:14:22.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.688+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b40c11d0 con 0x7ff2b40bc720 2020-11-20T12:14:22.699 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.688+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2b4044f60 con 0x7ff2b40bc720 2020-11-20T12:14:22.699 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.690+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff29c025030 con 0x7ff2b40bc720 2020-11-20T12:14:22.700 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2abfff700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff290080660 0x7ff290082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.700 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7ff29c0a4490 con 0x7ff2b40bc720 2020-11-20T12:14:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2b37fe700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff290080660 0x7ff290082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2abfff700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7ff290088d00 0x7ff29008b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 --> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff29008b780 con 0x7ff290088d00 2020-11-20T12:14:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff29c0a4780 con 0x7ff2b40bc720 2020-11-20T12:14:22.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2b3fff700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7ff290088d00 0x7ff29008b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.691+0000 7ff2b37fe700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff290080660 0x7ff290082b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff2a4001be0 tx=0x7ff2a4009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.692+0000 7ff2b3fff700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7ff290088d00 0x7ff29008b120 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.693+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== osd.9 v2:172.21.15.160:6817/17065 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7ff29008b780 con 0x7ff290088d00 2020-11-20T12:14:22.714 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.709+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 --> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2b4064530 con 0x7ff290088d00 2020-11-20T12:14:22.715 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.710+0000 7ff2abfff700 1 -- 172.21.15.160:0/2589752209 <== osd.9 v2:172.21.15.160:6817/17065 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2b4064530 con 0x7ff290088d00 2020-11-20T12:14:22.715 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.710+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7ff290088d00 msgr2=0x7ff29008b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.715 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.710+0000 7ff2b886d700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7ff290088d00 0x7ff29008b120 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.715 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.710+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff290080660 msgr2=0x7ff290082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.716 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.710+0000 7ff2b886d700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff290080660 0x7ff290082b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff2a4001be0 tx=0x7ff2a4009040).stop 2020-11-20T12:14:22.716 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.710+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2b40bc720 msgr2=0x7ff2b4151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.716 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.710+0000 7ff2b886d700 1 --2- 172.21.15.160:0/2589752209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2b40bc720 0x7ff2b4151ab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7ff29c012000 tx=0x7ff29c015000).stop 2020-11-20T12:14:22.717 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.711+0000 7ff2b3fff700 1 -- 172.21.15.160:0/2589752209 reap_dead start 2020-11-20T12:14:22.717 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.711+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 shutdown_connections 2020-11-20T12:14:22.717 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.711+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 >> 172.21.15.160:0/2589752209 conn(0x7ff2b4062ef0 msgr2=0x7ff2b40c25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:22.718 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.711+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 shutdown_connections 2020-11-20T12:14:22.718 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.711+0000 7ff2b886d700 1 -- 172.21.15.160:0/2589752209 wait complete. 2020-11-20T12:14:22.733 INFO:teuthology.orchestra.run.smithi160.stdout:73014444038 2020-11-20T12:14:22.734 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2020-11-20T12:14:22.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.973+0000 7f233bfff700 1 Processor -- start 2020-11-20T12:14:22.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.973+0000 7f233bfff700 1 -- start start 2020-11-20T12:14:22.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f233bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f233c151380 0x7f233c065330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f233bfff700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0c0260 con 0x7f233c0bfa20 2020-11-20T12:14:22.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f233bfff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0bb600 con 0x7f233c0bfe00 2020-11-20T12:14:22.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f233bfff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c065820 con 0x7f233c151380 2020-11-20T12:14:22.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f23327fc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f233c0bfe00 0x7f233c150c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46928/0 (socket says 172.21.15.160:46928) 2020-11-20T12:14:22.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f23327fc700 1 -- 172.21.15.160:0/2950871177 learned_addr learned my addr 172.21.15.160:0/2950871177 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:22.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f233affd700 1 --1- 172.21.15.160:0/2950871177 >> v1:172.21.15.134:6789/0 conn(0x7f233c0bfa20 0x7f233c0baef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60390/0 (socket says 172.21.15.160:60390) 2020-11-20T12:14:22.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.975+0000 7f233b7fe700 1 --2- 172.21.15.160:0/2950871177 >> v2:172.21.15.134:3300/0 conn(0x7f233c151380 0x7f233c065330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087852586 0 0) 0x7f233c0bb600 con 0x7f233c0bfe00 2020-11-20T12:14:22.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f231c003240 con 0x7f233c0bfe00 2020-11-20T12:14:22.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596243625 0 0) 0x7f232c0010d0 con 0x7f233c0bfa20 2020-11-20T12:14:22.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f233c0bb600 con 0x7f233c0bfa20 2020-11-20T12:14:22.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3707136330 0 0) 0x7f231c003240 con 0x7f233c0bfe00 2020-11-20T12:14:22.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 >> v2:172.21.15.134:3300/0 conn(0x7f233c151380 msgr2=0x7f233c065330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 --2- 172.21.15.160:0/2950871177 >> v2:172.21.15.134:3300/0 conn(0x7f233c151380 0x7f233c065330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 >> v1:172.21.15.134:6789/0 conn(0x7f233c0bfa20 legacy=0x7f233c0baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0bb890 con 0x7f233c0bfe00 2020-11-20T12:14:22.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f23240014e0 con 0x7f233c0bfe00 2020-11-20T12:14:22.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 >> v1:172.21.15.150:6789/0 conn(0x7f233c0bfe00 legacy=0x7f233c150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f231c003910 0x7f231c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0044e0 0x7f231c004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c004e50 0x7f231c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c065820 con 0x7f231c004e50 2020-11-20T12:14:22.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c00bc20 con 0x7f231c0044e0 2020-11-20T12:14:22.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231c00bd60 con 0x7f231c003910 2020-11-20T12:14:22.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.976+0000 7f23327fc700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0044e0 0x7f231c004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f233b7fe700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c004e50 0x7f231c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f233affd700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f231c003910 0x7f231c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f23327fc700 1 -- 172.21.15.160:0/2950871177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f231c003910 msgr2=0x7f231c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f23327fc700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f231c003910 0x7f231c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f23327fc700 1 -- 172.21.15.160:0/2950871177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c004e50 msgr2=0x7f231c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:22.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f23327fc700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c004e50 0x7f231c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f23327fc700 1 -- 172.21.15.160:0/2950871177 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c003240 con 0x7f231c0044e0 2020-11-20T12:14:22.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f233b7fe700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c004e50 0x7f231c00b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:22.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f233b7fe700 1 -- 172.21.15.160:0/2950871177 reap_dead start 2020-11-20T12:14:22.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.977+0000 7f23327fc700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0044e0 0x7f231c004960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f232400c440 tx=0x7f2324007780).ready entity=mon.1 client_cookie=af854294ed9a3f4d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:22.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400ce00 con 0x7f231c0044e0 2020-11-20T12:14:22.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23240072e0 con 0x7f231c0044e0 2020-11-20T12:14:22.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233a7fc700 1 -- 172.21.15.160:0/2950871177 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324005820 con 0x7f231c0044e0 2020-11-20T12:14:22.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233bfff700 1 -- 172.21.15.160:0/2950871177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0044e0 msgr2=0x7f231c004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:22.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233bfff700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0044e0 0x7f231c004960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f232400c440 tx=0x7f2324007780).stop 2020-11-20T12:14:22.995 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233bfff700 1 -- 172.21.15.160:0/2950871177 shutdown_connections 2020-11-20T12:14:22.996 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233bfff700 1 --2- 172.21.15.160:0/2950871177 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f231c0044e0 0x7f231c004960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:22.996 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233bfff700 1 -- 172.21.15.160:0/2950871177 >> 172.21.15.160:0/2950871177 conn(0x7f233c062ef0 msgr2=0x7f233c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:22.996 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233bfff700 1 -- 172.21.15.160:0/2950871177 shutdown_connections 2020-11-20T12:14:22.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.978+0000 7f233bfff700 1 -- 172.21.15.160:0/2950871177 wait complete. 2020-11-20T12:14:22.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.980+0000 7f233bfff700 1 Processor -- start 2020-11-20T12:14:22.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.980+0000 7f233bfff700 1 -- start start 2020-11-20T12:14:22.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c0044e0 0x7f233c157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f233c1570a0 0x7f233c14c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f233c14c540 0x7f233c163a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:22.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233bfff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c14df90 con 0x7f231c0044e0 2020-11-20T12:14:22.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c14d2e0 con 0x7f233c14c540 2020-11-20T12:14:22.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233bfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c14d510 con 0x7f233c1570a0 2020-11-20T12:14:22.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f23327fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f233c1570a0 0x7f233c14c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:22.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f23327fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f233c1570a0 0x7f233c14c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38096/0 (socket says 172.21.15.160:38096) 2020-11-20T12:14:23.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f23327fc700 1 -- 172.21.15.160:0/400089001 learned_addr learned my addr 172.21.15.160:0/400089001 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:23.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233affd700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c0044e0 0x7f233c157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.981+0000 7f233b7fe700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f233c14c540 0x7f233c163a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23327fc700 1 -- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f233c14c540 msgr2=0x7f233c163a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.001 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23327fc700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f233c14c540 0x7f233c163a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.001 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23327fc700 1 -- 172.21.15.160:0/400089001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c0044e0 msgr2=0x7f233c157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.001 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23327fc700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f231c0044e0 0x7f233c157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.001 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23327fc700 1 -- 172.21.15.160:0/400089001 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c14d7b0 con 0x7f233c1570a0 2020-11-20T12:14:23.001 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23327fc700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f233c1570a0 0x7f233c14c050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2324007550 tx=0x7f2324015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.002 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324005040 con 0x7f233c1570a0 2020-11-20T12:14:23.002 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23240051a0 con 0x7f233c1570a0 2020-11-20T12:14:23.002 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c14da50 con 0x7f233c1570a0 2020-11-20T12:14:23.002 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324005560 con 0x7f233c1570a0 2020-11-20T12:14:23.003 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.982+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c163580 con 0x7f233c1570a0 2020-11-20T12:14:23.003 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.983+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f233c044f60 con 0x7f233c1570a0 2020-11-20T12:14:23.003 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.985+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2324010070 con 0x7f233c1570a0 2020-11-20T12:14:23.003 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.986+0000 7f23337fe700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2318080630 0x7f2318082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.986+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f23240a4530 con 0x7f233c1570a0 2020-11-20T12:14:23.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.986+0000 7f23337fe700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7f2318088d50 0x7f231808b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.986+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 --> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f231808b7d0 con 0x7f2318088d50 2020-11-20T12:14:23.004 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.986+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23240a4860 con 0x7f233c1570a0 2020-11-20T12:14:23.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.986+0000 7f233affd700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2318080630 0x7f2318082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.986+0000 7f233b7fe700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7f2318088d50 0x7f231808b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.987+0000 7f233affd700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2318080630 0x7f2318082af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f232c001230 tx=0x7f232c007040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.987+0000 7f233b7fe700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7f2318088d50 0x7f231808b170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:22.988+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== osd.10 v2:172.21.15.150:6810/21743 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f231808b7d0 con 0x7f2318088d50 2020-11-20T12:14:23.008 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.005+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 --> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f233c163710 con 0x7f2318088d50 2020-11-20T12:14:23.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.006+0000 7f23337fe700 1 -- 172.21.15.160:0/400089001 <== osd.10 v2:172.21.15.150:6810/21743 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f233c163710 con 0x7f2318088d50 2020-11-20T12:14:23.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.006+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7f2318088d50 msgr2=0x7f231808b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.006+0000 7f233bfff700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7f2318088d50 0x7f231808b170 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.006+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2318080630 msgr2=0x7f2318082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.006+0000 7f233bfff700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2318080630 0x7f2318082af0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f232c001230 tx=0x7f232c007040).stop 2020-11-20T12:14:23.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.006+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f233c1570a0 msgr2=0x7f233c14c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.007+0000 7f233bfff700 1 --2- 172.21.15.160:0/400089001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f233c1570a0 0x7f233c14c050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2324007550 tx=0x7f2324015000).stop 2020-11-20T12:14:23.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.007+0000 7f233b7fe700 1 -- 172.21.15.160:0/400089001 reap_dead start 2020-11-20T12:14:23.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.007+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 shutdown_connections 2020-11-20T12:14:23.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.007+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 >> 172.21.15.160:0/400089001 conn(0x7f233c062ef0 msgr2=0x7f233c061ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:23.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.007+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 shutdown_connections 2020-11-20T12:14:23.012 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.007+0000 7f233bfff700 1 -- 172.21.15.160:0/400089001 wait complete. 2020-11-20T12:14:23.030 INFO:teuthology.orchestra.run.smithi160.stdout:73014444038 2020-11-20T12:14:23.030 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2020-11-20T12:14:23.274 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.271+0000 7f7240ef5700 1 Processor -- start 2020-11-20T12:14:23.275 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.271+0000 7f7240ef5700 1 -- start start 2020-11-20T12:14:23.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f7240ef5700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f723c1520d0 0x7f723c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f7240ef5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f723c0ba570 0x7f723c0bd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f7240ef5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f723c0bd700 0x7f723c0bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f7240ef5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723c0bdfa0 con 0x7f723c0bd700 2020-11-20T12:14:23.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f7240ef5700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723c0be240 con 0x7f723c1520d0 2020-11-20T12:14:23.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f7240ef5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723c0be4e0 con 0x7f723c0ba570 2020-11-20T12:14:23.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f723b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f723c1520d0 0x7f723c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f7233fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f723c0ba570 0x7f723c0bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f723b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f723c1520d0 0x7f723c1524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51240/0 (socket says 172.21.15.160:51240) 2020-11-20T12:14:23.279 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f723b7fe700 1 -- 172.21.15.160:0/3249154133 learned_addr learned my addr 172.21.15.160:0/3249154133 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:23.279 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.273+0000 7f723bfff700 1 --2- 172.21.15.160:0/3249154133 >> v2:172.21.15.134:3300/0 conn(0x7f723c0bd700 0x7f723c0bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f7233fff700 1 -- 172.21.15.160:0/3249154133 >> v2:172.21.15.150:3300/0 conn(0x7f723c1520d0 msgr2=0x7f723c1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:23.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f7233fff700 1 --2- 172.21.15.160:0/3249154133 >> v2:172.21.15.150:3300/0 conn(0x7f723c1520d0 0x7f723c1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f7233fff700 1 -- 172.21.15.160:0/3249154133 >> v2:172.21.15.134:3300/0 conn(0x7f723c0bd700 msgr2=0x7f723c0bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:23.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f7233fff700 1 --2- 172.21.15.160:0/3249154133 >> v2:172.21.15.134:3300/0 conn(0x7f723c0bd700 0x7f723c0bfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f7233fff700 1 -- 172.21.15.160:0/3249154133 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c0be780 con 0x7f723c0ba570 2020-11-20T12:14:23.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f723b7fe700 1 --2- 172.21.15.160:0/3249154133 >> v2:172.21.15.150:3300/0 conn(0x7f723c1520d0 0x7f723c1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:23.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f7233fff700 1 --2- 172.21.15.160:0/3249154133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0ba570 0x7f723c0bd210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f723c0c2d00 tx=0x7f7224006d90).ready entity=mon.2 client_cookie=b97c0fc619f1acaf server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f723affd700 1 -- 172.21.15.160:0/3249154133 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224006030 con 0x7f723c0ba570 2020-11-20T12:14:23.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.274+0000 7f723affd700 1 -- 172.21.15.160:0/3249154133 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224006190 con 0x7f723c0ba570 2020-11-20T12:14:23.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f723affd700 1 -- 172.21.15.160:0/3249154133 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224006510 con 0x7f723c0ba570 2020-11-20T12:14:23.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 -- 172.21.15.160:0/3249154133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0ba570 msgr2=0x7f723c0bd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 --2- 172.21.15.160:0/3249154133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0ba570 0x7f723c0bd210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f723c0c2d00 tx=0x7f7224006d90).stop 2020-11-20T12:14:23.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 -- 172.21.15.160:0/3249154133 shutdown_connections 2020-11-20T12:14:23.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 --2- 172.21.15.160:0/3249154133 >> v2:172.21.15.134:3300/0 conn(0x7f723c0bd700 0x7f723c0bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 --2- 172.21.15.160:0/3249154133 >> v2:172.21.15.150:3300/0 conn(0x7f723c1520d0 0x7f723c1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 --2- 172.21.15.160:0/3249154133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0ba570 0x7f723c0bd210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 -- 172.21.15.160:0/3249154133 >> 172.21.15.160:0/3249154133 conn(0x7f723c060bd0 msgr2=0x7f723c0c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:23.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 -- 172.21.15.160:0/3249154133 shutdown_connections 2020-11-20T12:14:23.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.275+0000 7f7240ef5700 1 -- 172.21.15.160:0/3249154133 wait complete. 2020-11-20T12:14:23.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.277+0000 7f7240ef5700 1 Processor -- start 2020-11-20T12:14:23.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.277+0000 7f7240ef5700 1 -- start start 2020-11-20T12:14:23.288 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7240ef5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723c0ba570 0x7f723c067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.288 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7240ef5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0bd700 0x7f723c064050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.288 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7240ef5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f723c1520d0 0x7f723c160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.288 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7240ef5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c163670 con 0x7f723c1520d0 2020-11-20T12:14:23.288 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7240ef5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c163910 con 0x7f723c0ba570 2020-11-20T12:14:23.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7240ef5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c163bb0 con 0x7f723c0bd700 2020-11-20T12:14:23.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7233fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0bd700 0x7f723c064050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7233fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0bd700 0x7f723c064050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38110/0 (socket says 172.21.15.160:38110) 2020-11-20T12:14:23.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f7233fff700 1 -- 172.21.15.160:0/2649292376 learned_addr learned my addr 172.21.15.160:0/2649292376 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:23.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f723bfff700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f723c1520d0 0x7f723c160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.278+0000 7f723b7fe700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723c0ba570 0x7f723c067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7233fff700 1 -- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723c0ba570 msgr2=0x7f723c067460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7233fff700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f723c0ba570 0x7f723c067460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7233fff700 1 -- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f723c1520d0 msgr2=0x7f723c160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7233fff700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f723c1520d0 0x7f723c160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7233fff700 1 -- 172.21.15.160:0/2649292376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c163e50 con 0x7f723c0bd700 2020-11-20T12:14:23.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7233fff700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0bd700 0x7f723c064050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7224006fd0 tx=0x7f7224015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224021070 con 0x7f723c0bd700 2020-11-20T12:14:23.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72240099b0 con 0x7f723c0bd700 2020-11-20T12:14:23.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224009d30 con 0x7f723c0bd700 2020-11-20T12:14:23.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723c1640f0 con 0x7f723c0bd700 2020-11-20T12:14:23.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.279+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c154d80 con 0x7f723c0bd700 2020-11-20T12:14:23.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.280+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f723c044f60 con 0x7f723c0bd700 2020-11-20T12:14:23.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.281+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f722400f070 con 0x7f723c0bd700 2020-11-20T12:14:23.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.282+0000 7f72337fe700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7218080630 0x7f7218082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.283+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f72240a4bf0 con 0x7f723c0bd700 2020-11-20T12:14:23.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.283+0000 7f723b7fe700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7218080630 0x7f7218082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.283+0000 7f72337fe700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f7218088cd0 0x7f721808b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.283+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 --> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f721808b750 con 0x7f7218088cd0 2020-11-20T12:14:23.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.283+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72240a4ee0 con 0x7f723c0bd700 2020-11-20T12:14:23.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.283+0000 7f723b7fe700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7218080630 0x7f7218082af0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f722c006fd0 tx=0x7f722c008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.283+0000 7f723bfff700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f7218088cd0 0x7f721808b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.284+0000 7f723bfff700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f7218088cd0 0x7f721808b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.285+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== osd.11 v2:172.21.15.134:6824/22225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f721808b750 con 0x7f7218088cd0 2020-11-20T12:14:23.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.301+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 --> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f723c163250 con 0x7f7218088cd0 2020-11-20T12:14:23.305 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f72337fe700 1 -- 172.21.15.160:0/2649292376 <== osd.11 v2:172.21.15.134:6824/22225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f723c163250 con 0x7f7218088cd0 2020-11-20T12:14:23.306 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f7218088cd0 msgr2=0x7f721808b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.306 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f7218088cd0 0x7f721808b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.306 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7218080630 msgr2=0x7f7218082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.307 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7218080630 0x7f7218082af0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f722c006fd0 tx=0x7f722c008040).stop 2020-11-20T12:14:23.307 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0bd700 msgr2=0x7f723c064050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.307 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 --2- 172.21.15.160:0/2649292376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f723c0bd700 0x7f723c064050 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f7224006fd0 tx=0x7f7224015000).stop 2020-11-20T12:14:23.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f723bfff700 1 -- 172.21.15.160:0/2649292376 reap_dead start 2020-11-20T12:14:23.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 shutdown_connections 2020-11-20T12:14:23.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 >> 172.21.15.160:0/2649292376 conn(0x7f723c060bd0 msgr2=0x7f723c0c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:23.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.302+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 shutdown_connections 2020-11-20T12:14:23.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.303+0000 7f7240ef5700 1 -- 172.21.15.160:0/2649292376 wait complete. 2020-11-20T12:14:23.325 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:23.326 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T12:14:23.571 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.567+0000 7fee50fea700 1 Processor -- start 2020-11-20T12:14:23.571 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.568+0000 7fee50fea700 1 -- start start 2020-11-20T12:14:23.572 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.569+0000 7fee50fea700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c14da40 con 0x7fee4c0ba8f0 2020-11-20T12:14:23.573 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.569+0000 7fee50fea700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c14dce0 con 0x7fee4c151a90 2020-11-20T12:14:23.573 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.569+0000 7fee50fea700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c14df80 con 0x7fee4c0ba510 2020-11-20T12:14:23.575 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.570+0000 7fee42ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fee4c151a90 0x7fee4c14f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:46968/0 (socket says 172.21.15.160:46968) 2020-11-20T12:14:23.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.570+0000 7fee42ffd700 1 -- 172.21.15.160:0/3568646526 learned_addr learned my addr 172.21.15.160:0/3568646526 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:23.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.570+0000 7fee4bfff700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fee4c0ba8f0 0x7fee4c1584b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60428/0 (socket says 172.21.15.160:60428) 2020-11-20T12:14:23.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.570+0000 7fee4b7fe700 1 --1- 172.21.15.160:0/3568646526 >> v1:172.21.15.160:6789/0 conn(0x7fee4c0ba510 0x7fee4c0bc030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55702/0 (socket says 172.21.15.160:55702) 2020-11-20T12:14:23.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.570+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629403314 0 0) 0x7fee4c14dce0 con 0x7fee4c151a90 2020-11-20T12:14:23.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee2c003240 con 0x7fee4c151a90 2020-11-20T12:14:23.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596398503 0 0) 0x7fee4c14da40 con 0x7fee4c0ba8f0 2020-11-20T12:14:23.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c14dce0 con 0x7fee4c0ba8f0 2020-11-20T12:14:23.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450004176 0 0) 0x7fee4c14df80 con 0x7fee4c0ba510 2020-11-20T12:14:23.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c14da40 con 0x7fee4c0ba510 2020-11-20T12:14:23.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2970450740 0 0) 0x7fee2c003240 con 0x7fee4c151a90 2020-11-20T12:14:23.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 >> v1:172.21.15.160:6789/0 conn(0x7fee4c0ba510 legacy=0x7fee4c0bc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 >> v1:172.21.15.134:6789/0 conn(0x7fee4c0ba8f0 legacy=0x7fee4c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c14e220 con 0x7fee4c151a90 2020-11-20T12:14:23.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.571+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7fee340014e0 con 0x7fee4c151a90 2020-11-20T12:14:23.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 >> v1:172.21.15.150:6789/0 conn(0x7fee4c151a90 legacy=0x7fee4c14f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4affd700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee2c004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4affd700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee2c003480 0x7fee2c003900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4affd700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c003e90 0x7fee2c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c00bc20 con 0x7fee2c003e90 2020-11-20T12:14:23.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c00bd60 con 0x7fee2c004ae0 2020-11-20T12:14:23.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c00bf20 con 0x7fee2c003480 2020-11-20T12:14:23.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4b7fe700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee2c004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.581 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee42ffd700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee2c003480 0x7fee2c003900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.581 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.572+0000 7fee4bfff700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c003e90 0x7fee2c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.585 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4b7fe700 1 -- 172.21.15.160:0/3568646526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee2c003480 msgr2=0x7fee2c003900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:23.585 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4b7fe700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee2c003480 0x7fee2c003900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.585 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4b7fe700 1 -- 172.21.15.160:0/3568646526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c003e90 msgr2=0x7fee2c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:23.585 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4b7fe700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c003e90 0x7fee2c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.586 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4b7fe700 1 -- 172.21.15.160:0/3568646526 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c003240 con 0x7fee2c004ae0 2020-11-20T12:14:23.586 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4bfff700 1 -- 172.21.15.160:0/3568646526 reap_dead start 2020-11-20T12:14:23.586 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee42ffd700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee2c003480 0x7fee2c003900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:23.586 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4b7fe700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee2c004ec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fee3c0019b0 tx=0x7fee3c007ba0).ready entity=mon.1 client_cookie=a7cdcf28d2825485 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.586 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0072e0 con 0x7fee2c004ae0 2020-11-20T12:14:23.587 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c00e830 con 0x7fee2c004ae0 2020-11-20T12:14:23.587 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.573+0000 7fee4affd700 1 -- 172.21.15.160:0/3568646526 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c00ebd0 con 0x7fee2c004ae0 2020-11-20T12:14:23.587 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.574+0000 7fee50fea700 1 -- 172.21.15.160:0/3568646526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 msgr2=0x7fee2c004ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.587 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.574+0000 7fee50fea700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee2c004ec0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fee3c0019b0 tx=0x7fee3c007ba0).stop 2020-11-20T12:14:23.588 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.574+0000 7fee50fea700 1 -- 172.21.15.160:0/3568646526 shutdown_connections 2020-11-20T12:14:23.588 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.574+0000 7fee50fea700 1 --2- 172.21.15.160:0/3568646526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee2c004ec0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.589 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.574+0000 7fee50fea700 1 -- 172.21.15.160:0/3568646526 >> 172.21.15.160:0/3568646526 conn(0x7fee4c062ef0 msgr2=0x7fee4c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:23.589 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.574+0000 7fee50fea700 1 -- 172.21.15.160:0/3568646526 shutdown_connections 2020-11-20T12:14:23.589 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.574+0000 7fee50fea700 1 -- 172.21.15.160:0/3568646526 wait complete. 2020-11-20T12:14:23.590 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.576+0000 7fee50fea700 1 Processor -- start 2020-11-20T12:14:23.590 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.576+0000 7fee50fea700 1 -- start start 2020-11-20T12:14:23.590 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.576+0000 7fee50fea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee4c160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.590 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee50fea700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee4c14cd50 0x7fee4c163920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.591 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee50fea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee4c146ce0 0x7fee4c065200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.591 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee50fea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c28c0 con 0x7fee4c146ce0 2020-11-20T12:14:23.591 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee50fea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c2380 con 0x7fee2c004ae0 2020-11-20T12:14:23.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee50fea700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c2620 con 0x7fee4c14cd50 2020-11-20T12:14:23.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee4c14cd50 0x7fee4c163920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee4c14cd50 0x7fee4c163920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38134/0 (socket says 172.21.15.160:38134) 2020-11-20T12:14:23.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 -- 172.21.15.160:0/3794082800 learned_addr learned my addr 172.21.15.160:0/3794082800 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:23.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee4bfff700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee4c146ce0 0x7fee4c065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee4b7fe700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee4c160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 -- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 msgr2=0x7fee4c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee4c160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 -- 172.21.15.160:0/3794082800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee4c146ce0 msgr2=0x7fee4c065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee4c146ce0 0x7fee4c065200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee42ffd700 1 -- 172.21.15.160:0/3794082800 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c15fb40 con 0x7fee4c14cd50 2020-11-20T12:14:23.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.577+0000 7fee4bfff700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee4c146ce0 0x7fee4c065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:23.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.578+0000 7fee42ffd700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee4c14cd50 0x7fee4c163920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fee34000da0 tx=0x7fee4c14de70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.578+0000 7fee43fff700 1 -- 172.21.15.160:0/3794082800 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3400fc40 con 0x7fee4c14cd50 2020-11-20T12:14:23.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.578+0000 7fee43fff700 1 -- 172.21.15.160:0/3794082800 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3400fda0 con 0x7fee4c14cd50 2020-11-20T12:14:23.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.578+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c15fde0 con 0x7fee4c14cd50 2020-11-20T12:14:23.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.578+0000 7fee43fff700 1 -- 172.21.15.160:0/3794082800 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34015640 con 0x7fee4c14cd50 2020-11-20T12:14:23.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.578+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c0c2000 con 0x7fee4c14cd50 2020-11-20T12:14:23.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.579+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c044f60 con 0x7fee4c14cd50 2020-11-20T12:14:23.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.580+0000 7fee43fff700 1 -- 172.21.15.160:0/3794082800 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fee34015a30 con 0x7fee4c14cd50 2020-11-20T12:14:23.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.581+0000 7fee43fff700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fee28080660 0x7fee28082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:23.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.581+0000 7fee43fff700 1 -- 172.21.15.160:0/3794082800 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fee340a27c0 con 0x7fee4c14cd50 2020-11-20T12:14:23.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.582+0000 7fee4b7fe700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fee28080660 0x7fee28082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:23.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.582+0000 7fee4b7fe700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fee28080660 0x7fee28082b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fee3c0019b0 tx=0x7fee3c017000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:23.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.585+0000 7fee43fff700 1 -- 172.21.15.160:0/3794082800 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fee34077360 con 0x7fee4c14cd50 2020-11-20T12:14:23.775 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.771+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee4c060d50 con 0x7fee4c14cd50 2020-11-20T12:14:23.775 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.771+0000 7fee43fff700 1 -- 172.21.15.160:0/3794082800 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee3407a980 con 0x7fee4c14cd50 2020-11-20T12:14:23.775 INFO:teuthology.orchestra.run.smithi160.stdout:73014444038 2020-11-20T12:14:23.776 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.773+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fee28080660 msgr2=0x7fee28082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.777 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.773+0000 7fee50fea700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fee28080660 0x7fee28082b20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fee3c0019b0 tx=0x7fee3c017000).stop 2020-11-20T12:14:23.777 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.773+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee4c14cd50 msgr2=0x7fee4c163920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:23.777 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.773+0000 7fee50fea700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee4c14cd50 0x7fee4c163920 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fee34000da0 tx=0x7fee4c14de70).stop 2020-11-20T12:14:23.778 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 shutdown_connections 2020-11-20T12:14:23.778 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fee28080660 0x7fee28082b20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.778 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee4c146ce0 0x7fee4c065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.778 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee2c004ae0 0x7fee4c160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.779 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 --2- 172.21.15.160:0/3794082800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee4c14cd50 0x7fee4c163920 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:23.779 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 >> 172.21.15.160:0/3794082800 conn(0x7fee4c062ef0 msgr2=0x7fee4c149620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:23.779 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 shutdown_connections 2020-11-20T12:14:23.779 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:23.774+0000 7fee50fea700 1 -- 172.21.15.160:0/3794082800 wait complete. 2020-11-20T12:14:23.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.0 2020-11-20T12:14:23.805 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-20T12:14:24.058 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.054+0000 7fd95b59e700 1 Processor -- start 2020-11-20T12:14:24.415 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.054+0000 7fd95b59e700 1 -- start start 2020-11-20T12:14:24.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95b59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fd95c151a90 0x7fd95c0ba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95b59e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd95c0bc740 0x7fd95c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95b59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c14da40 con 0x7fd95c0ba510 2020-11-20T12:14:24.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95b59e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0bcbd0 con 0x7fd95c0bc740 2020-11-20T12:14:24.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95b59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c14dce0 con 0x7fd95c151a90 2020-11-20T12:14:24.429 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95a59c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fd95c0ba510 0x7fd95c0bc030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55720/0 (socket says 172.21.15.160:55720) 2020-11-20T12:14:24.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95a59c700 1 -- 172.21.15.160:0/1333944505 learned_addr learned my addr 172.21.15.160:0/1333944505 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:24.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd951d9b700 1 --2- 172.21.15.160:0/1333944505 >> v2:172.21.15.150:3300/0 conn(0x7fd95c151a90 0x7fd95c0ba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd95ad9d700 1 --2- 172.21.15.160:0/1333944505 >> v2:172.21.15.134:3300/0 conn(0x7fd95c0bc740 0x7fd95c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.056+0000 7fd959d9b700 1 -- 172.21.15.160:0/1333944505 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248710565 0 0) 0x7fd95c14da40 con 0x7fd95c0ba510 2020-11-20T12:14:24.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd959d9b700 1 -- 172.21.15.160:0/1333944505 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c003240 con 0x7fd95c0ba510 2020-11-20T12:14:24.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd951d9b700 1 -- 172.21.15.160:0/1333944505 >> v2:172.21.15.134:3300/0 conn(0x7fd95c0bc740 msgr2=0x7fd95c14f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:24.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd951d9b700 1 --2- 172.21.15.160:0/1333944505 >> v2:172.21.15.134:3300/0 conn(0x7fd95c0bc740 0x7fd95c14f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd951d9b700 1 -- 172.21.15.160:0/1333944505 >> v1:172.21.15.160:6789/0 conn(0x7fd95c0ba510 legacy=0x7fd95c0bc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd951d9b700 1 -- 172.21.15.160:0/1333944505 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c14df80 con 0x7fd95c151a90 2020-11-20T12:14:24.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd951d9b700 1 --2- 172.21.15.160:0/1333944505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c151a90 0x7fd95c0ba8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd95c067590 tx=0x7fd944006df0).ready entity=mon.1 client_cookie=ee34bcc757dc6ea5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:24.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd959d9b700 1 -- 172.21.15.160:0/1333944505 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440096d0 con 0x7fd95c151a90 2020-11-20T12:14:24.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd959d9b700 1 -- 172.21.15.160:0/1333944505 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944009830 con 0x7fd95c151a90 2020-11-20T12:14:24.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.057+0000 7fd959d9b700 1 -- 172.21.15.160:0/1333944505 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944009bb0 con 0x7fd95c151a90 2020-11-20T12:14:24.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 -- 172.21.15.160:0/1333944505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c151a90 msgr2=0x7fd95c0ba8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.435 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 --2- 172.21.15.160:0/1333944505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c151a90 0x7fd95c0ba8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd95c067590 tx=0x7fd944006df0).stop 2020-11-20T12:14:24.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 -- 172.21.15.160:0/1333944505 shutdown_connections 2020-11-20T12:14:24.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 --2- 172.21.15.160:0/1333944505 >> v2:172.21.15.134:3300/0 conn(0x7fd95c0bc740 0x7fd95c14f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 --2- 172.21.15.160:0/1333944505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c151a90 0x7fd95c0ba8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 -- 172.21.15.160:0/1333944505 >> 172.21.15.160:0/1333944505 conn(0x7fd95c062ef0 msgr2=0x7fd95c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:24.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 -- 172.21.15.160:0/1333944505 shutdown_connections 2020-11-20T12:14:24.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.058+0000 7fd95b59e700 1 -- 172.21.15.160:0/1333944505 wait complete. 2020-11-20T12:14:24.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.060+0000 7fd95b59e700 1 Processor -- start 2020-11-20T12:14:24.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.061+0000 7fd95b59e700 1 -- start start 2020-11-20T12:14:24.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95b59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c0ba510 0x7fd95c0c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c0bc740 0x7fd95c164140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd95c151a90 0x7fd95c0be540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95b59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c2cb0 con 0x7fd95c0ba510 2020-11-20T12:14:24.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c164970 con 0x7fd95c0bc740 2020-11-20T12:14:24.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95b59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c164c10 con 0x7fd95c151a90 2020-11-20T12:14:24.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c0ba510 0x7fd95c0c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd95c151a90 0x7fd95c0be540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95a59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c0ba510 0x7fd95c0c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60668/0 (socket says 172.21.15.160:60668) 2020-11-20T12:14:24.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd951d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c0bc740 0x7fd95c164140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.062+0000 7fd95a59c700 1 -- 172.21.15.160:0/2699872955 learned_addr learned my addr 172.21.15.160:0/2699872955 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:24.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95a59c700 1 -- 172.21.15.160:0/2699872955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd95c151a90 msgr2=0x7fd95c0be540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95a59c700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd95c151a90 0x7fd95c0be540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95a59c700 1 -- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c0bc740 msgr2=0x7fd95c164140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95a59c700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c0bc740 0x7fd95c164140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95a59c700 1 -- 172.21.15.160:0/2699872955 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c164eb0 con 0x7fd95c0ba510 2020-11-20T12:14:24.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd951d9b700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c0bc740 0x7fd95c164140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:24.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95a59c700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c0ba510 0x7fd95c0c27c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fd94c00c6a0 tx=0x7fd94c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:24.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd952ffd700 1 -- 172.21.15.160:0/2699872955 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c0072e0 con 0x7fd95c0ba510 2020-11-20T12:14:24.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd952ffd700 1 -- 172.21.15.160:0/2699872955 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c007440 con 0x7fd95c0ba510 2020-11-20T12:14:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c0bde00 con 0x7fd95c0ba510 2020-11-20T12:14:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd952ffd700 1 -- 172.21.15.160:0/2699872955 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c005820 con 0x7fd95c0ba510 2020-11-20T12:14:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.063+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c164630 con 0x7fd95c0ba510 2020-11-20T12:14:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.065+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c165040 con 0x7fd95c0ba510 2020-11-20T12:14:24.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.066+0000 7fd952ffd700 1 -- 172.21.15.160:0/2699872955 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd94c010070 con 0x7fd95c0ba510 2020-11-20T12:14:24.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.067+0000 7fd952ffd700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd938080660 0x7fd938082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.067+0000 7fd952ffd700 1 -- 172.21.15.160:0/2699872955 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fd94c0a1e30 con 0x7fd95c0ba510 2020-11-20T12:14:24.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.067+0000 7fd951d9b700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd938080660 0x7fd938082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.068+0000 7fd951d9b700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd938080660 0x7fd938082b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd95c067590 tx=0x7fd944015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.071+0000 7fd952ffd700 1 -- 172.21.15.160:0/2699872955 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd94c0769b0 con 0x7fd95c0ba510 2020-11-20T12:14:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.257+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd95c044f60 con 0x7fd95c0ba510 2020-11-20T12:14:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.258+0000 7fd952ffd700 1 -- 172.21.15.160:0/2699872955 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd94c079fd0 con 0x7fd95c0ba510 2020-11-20T12:14:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd938080660 msgr2=0x7fd938082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd938080660 0x7fd938082b20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fd95c067590 tx=0x7fd944015000).stop 2020-11-20T12:14:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c0ba510 msgr2=0x7fd95c0c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c0ba510 0x7fd95c0c27c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fd94c00c6a0 tx=0x7fd94c007ac0).stop 2020-11-20T12:14:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 shutdown_connections 2020-11-20T12:14:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd938080660 0x7fd938082b20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd95c151a90 0x7fd95c0be540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95c0ba510 0x7fd95c0c27c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 --2- 172.21.15.160:0/2699872955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd95c0bc740 0x7fd95c164140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 >> 172.21.15.160:0/2699872955 conn(0x7fd95c062ef0 msgr2=0x7fd95c14f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 shutdown_connections 2020-11-20T12:14:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.260+0000 7fd95b59e700 1 -- 172.21.15.160:0/2699872955 wait complete. 2020-11-20T12:14:24.451 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:24.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.1 2020-11-20T12:14:24.452 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-20T12:14:24.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.700+0000 7f0174ae9700 1 Processor -- start 2020-11-20T12:14:24.704 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.700+0000 7f0174ae9700 1 -- start start 2020-11-20T12:14:24.705 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f0174ae9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01700bc720 0x7f01700bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f0174ae9700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f017014f590 0x7f0170065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f0174ae9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f01700bf4b0 0x7f01700bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f0174ae9700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0170065eb0 con 0x7f017014f590 2020-11-20T12:14:24.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f0174ae9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017014ebf0 con 0x7f01700bf4b0 2020-11-20T12:14:24.706 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f0174ae9700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017014f9f0 con 0x7f01700bc720 2020-11-20T12:14:24.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f016f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01700bc720 0x7f01700bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f016effd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f017014f590 0x7f0170065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f016effd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f017014f590 0x7f0170065200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60678/0 (socket says 172.21.15.160:60678) 2020-11-20T12:14:24.707 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f016effd700 1 -- 172.21.15.160:0/2613139808 learned_addr learned my addr 172.21.15.160:0/2613139808 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:24.708 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f016ffff700 1 --2- 172.21.15.160:0/2613139808 >> v2:172.21.15.150:3300/0 conn(0x7f01700bf4b0 0x7f01700bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.708 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.702+0000 7f016f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f01700bc720 0x7f01700bcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38154/0 (socket says 172.21.15.160:38154) 2020-11-20T12:14:24.709 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016effd700 1 -- 172.21.15.160:0/2613139808 >> v2:172.21.15.160:3300/0 conn(0x7f01700bc720 msgr2=0x7f01700bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:24.709 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016effd700 1 --2- 172.21.15.160:0/2613139808 >> v2:172.21.15.160:3300/0 conn(0x7f01700bc720 0x7f01700bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.710 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016effd700 1 -- 172.21.15.160:0/2613139808 >> v2:172.21.15.150:3300/0 conn(0x7f01700bf4b0 msgr2=0x7f01700bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:24.710 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016effd700 1 --2- 172.21.15.160:0/2613139808 >> v2:172.21.15.150:3300/0 conn(0x7f01700bf4b0 0x7f01700bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.710 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016effd700 1 -- 172.21.15.160:0/2613139808 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700656f0 con 0x7f017014f590 2020-11-20T12:14:24.710 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016ffff700 1 --2- 172.21.15.160:0/2613139808 >> v2:172.21.15.150:3300/0 conn(0x7f01700bf4b0 0x7f01700bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:24.711 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016effd700 1 --2- 172.21.15.160:0/2613139808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f017014f590 0x7f0170065200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f01700bf1d0 tx=0x7f0158006eb0).ready entity=mon.0 client_cookie=2fbe10780f5edef5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:24.711 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.703+0000 7f016e7fc700 1 -- 172.21.15.160:0/2613139808 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01580097b0 con 0x7f017014f590 2020-11-20T12:14:24.711 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f016e7fc700 1 -- 172.21.15.160:0/2613139808 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158009910 con 0x7f017014f590 2020-11-20T12:14:24.711 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f016e7fc700 1 -- 172.21.15.160:0/2613139808 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158009c90 con 0x7f017014f590 2020-11-20T12:14:24.711 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 -- 172.21.15.160:0/2613139808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f017014f590 msgr2=0x7f0170065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.712 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2613139808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f017014f590 0x7f0170065200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f01700bf1d0 tx=0x7f0158006eb0).stop 2020-11-20T12:14:24.712 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 -- 172.21.15.160:0/2613139808 shutdown_connections 2020-11-20T12:14:24.712 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2613139808 >> v2:172.21.15.160:3300/0 conn(0x7f01700bc720 0x7f01700bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.712 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2613139808 >> v2:172.21.15.150:3300/0 conn(0x7f01700bf4b0 0x7f01700bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.712 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2613139808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f017014f590 0x7f0170065200 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.713 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 -- 172.21.15.160:0/2613139808 >> 172.21.15.160:0/2613139808 conn(0x7f0170062ef0 msgr2=0x7f0170063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:24.713 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 -- 172.21.15.160:0/2613139808 shutdown_connections 2020-11-20T12:14:24.713 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.704+0000 7f0174ae9700 1 -- 172.21.15.160:0/2613139808 wait complete. 2020-11-20T12:14:24.713 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.706+0000 7f0174ae9700 1 Processor -- start 2020-11-20T12:14:24.715 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.707+0000 7f0174ae9700 1 -- start start 2020-11-20T12:14:24.715 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f0174ae9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01700bc720 0x7f01701526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.716 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f0174ae9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700bf4b0 0x7f017010d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.716 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f0174ae9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f017014f590 0x7f0170162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.717 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f0174ae9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170150c70 con 0x7f01700bc720 2020-11-20T12:14:24.717 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f0174ae9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170162770 con 0x7f017014f590 2020-11-20T12:14:24.717 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f0174ae9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017014bf10 con 0x7f01700bf4b0 2020-11-20T12:14:24.718 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01700bc720 0x7f01701526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.718 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f016effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700bf4b0 0x7f017010d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.719 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01700bc720 0x7f01701526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60682/0 (socket says 172.21.15.160:60682) 2020-11-20T12:14:24.719 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f016f7fe700 1 -- 172.21.15.160:0/2192978027 learned_addr learned my addr 172.21.15.160:0/2192978027 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:24.719 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.708+0000 7f016ffff700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f017014f590 0x7f0170162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.720 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f016f7fe700 1 -- 172.21.15.160:0/2192978027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700bf4b0 msgr2=0x7f017010d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.721 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f016f7fe700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700bf4b0 0x7f017010d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.721 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f016f7fe700 1 -- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f017014f590 msgr2=0x7f0170162280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.721 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f016f7fe700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f017014f590 0x7f0170162280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.722 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f016f7fe700 1 -- 172.21.15.160:0/2192978027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01701101e0 con 0x7f01700bc720 2020-11-20T12:14:24.722 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f016f7fe700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01700bc720 0x7f01701526f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f016800eba0 tx=0x7f0168006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:24.723 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f01677fe700 1 -- 172.21.15.160:0/2192978027 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800c8f0 con 0x7f01700bc720 2020-11-20T12:14:24.723 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f01677fe700 1 -- 172.21.15.160:0/2192978027 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800ca50 con 0x7f01700bc720 2020-11-20T12:14:24.723 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0170110480 con 0x7f01700bc720 2020-11-20T12:14:24.724 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f01677fe700 1 -- 172.21.15.160:0/2192978027 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800cdd0 con 0x7f01700bc720 2020-11-20T12:14:24.724 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.709+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0170151140 con 0x7f01700bc720 2020-11-20T12:14:24.725 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.711+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0170044f60 con 0x7f01700bc720 2020-11-20T12:14:24.725 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.712+0000 7f01677fe700 1 -- 172.21.15.160:0/2192978027 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0168012600 con 0x7f01700bc720 2020-11-20T12:14:24.727 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.713+0000 7f01677fe700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f014c080630 0x7f014c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:24.727 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.713+0000 7f01677fe700 1 -- 172.21.15.160:0/2192978027 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f01680a2bb0 con 0x7f01700bc720 2020-11-20T12:14:24.727 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.713+0000 7f016effd700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f014c080630 0x7f014c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:24.728 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.714+0000 7f016effd700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f014c080630 0x7f014c082af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f01700bf1d0 tx=0x7f0158015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:24.728 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.716+0000 7f01677fe700 1 -- 172.21.15.160:0/2192978027 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f01680a9080 con 0x7f01700bc720 2020-11-20T12:14:24.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.903+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f01700654d0 con 0x7f01700bc720 2020-11-20T12:14:24.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.904+0000 7f01677fe700 1 -- 172.21.15.160:0/2192978027 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01680777b0 con 0x7f01700bc720 2020-11-20T12:14:24.908 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:24.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f014c080630 msgr2=0x7f014c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f014c080630 0x7f014c082af0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f01700bf1d0 tx=0x7f0158015000).stop 2020-11-20T12:14:24.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01700bc720 msgr2=0x7f01701526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:24.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01700bc720 0x7f01701526f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f016800eba0 tx=0x7f0168006df0).stop 2020-11-20T12:14:24.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 shutdown_connections 2020-11-20T12:14:24.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f014c080630 0x7f014c082af0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f017014f590 0x7f0170162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01700bc720 0x7f01701526f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 --2- 172.21.15.160:0/2192978027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700bf4b0 0x7f017010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:24.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 >> 172.21.15.160:0/2192978027 conn(0x7f0170062ef0 msgr2=0x7f017005ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:24.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 shutdown_connections 2020-11-20T12:14:24.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:24.906+0000 7f0174ae9700 1 -- 172.21.15.160:0/2192978027 wait complete. 2020-11-20T12:14:24.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444039 for osd.2 2020-11-20T12:14:24.935 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-20T12:14:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.178+0000 7f95d3fff700 1 Processor -- start 2020-11-20T12:14:25.182 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.178+0000 7f95d3fff700 1 -- start start 2020-11-20T12:14:25.183 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d3fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95d40bc720 0x7f95d40bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d3fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f95d414f590 0x7f95d4065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d3fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95d40bf4b0 0x7f95d40bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d3fff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d4065eb0 con 0x7f95d414f590 2020-11-20T12:14:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d3fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d414ebf0 con 0x7f95d40bc720 2020-11-20T12:14:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d3fff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d414f9f0 con 0x7f95d40bf4b0 2020-11-20T12:14:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95d40bf4b0 0x7f95d40bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d2ffd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f95d40bc720 0x7f95d40bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d37fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f95d40bf4b0 0x7f95d40bd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38170/0 (socket says 172.21.15.160:38170) 2020-11-20T12:14:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95d37fe700 1 -- 172.21.15.160:0/3326454938 learned_addr learned my addr 172.21.15.160:0/3326454938 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.180+0000 7f95ca7fc700 1 --2- 172.21.15.160:0/3326454938 >> v2:172.21.15.134:3300/0 conn(0x7f95d414f590 0x7f95d4065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.181+0000 7f95d37fe700 1 -- 172.21.15.160:0/3326454938 >> v2:172.21.15.150:3300/0 conn(0x7f95d40bc720 msgr2=0x7f95d40bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.181+0000 7f95d37fe700 1 --2- 172.21.15.160:0/3326454938 >> v2:172.21.15.150:3300/0 conn(0x7f95d40bc720 0x7f95d40bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.187 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.181+0000 7f95d37fe700 1 -- 172.21.15.160:0/3326454938 >> v2:172.21.15.134:3300/0 conn(0x7f95d414f590 msgr2=0x7f95d4065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:25.187 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.181+0000 7f95d37fe700 1 --2- 172.21.15.160:0/3326454938 >> v2:172.21.15.134:3300/0 conn(0x7f95d414f590 0x7f95d4065200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.189 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.181+0000 7f95d37fe700 1 -- 172.21.15.160:0/3326454938 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40656f0 con 0x7f95d40bf4b0 2020-11-20T12:14:25.189 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.181+0000 7f95d37fe700 1 --2- 172.21.15.160:0/3326454938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bf4b0 0x7f95d40bd8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f95d40c3fa0 tx=0x7f95cc009290).ready entity=mon.2 client_cookie=308b511552c425cf server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:25.189 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.181+0000 7f95d27fc700 1 -- 172.21.15.160:0/3326454938 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00bba0 con 0x7f95d40bf4b0 2020-11-20T12:14:25.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d27fc700 1 -- 172.21.15.160:0/3326454938 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc00bd00 con 0x7f95d40bf4b0 2020-11-20T12:14:25.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d27fc700 1 -- 172.21.15.160:0/3326454938 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc011610 con 0x7f95d40bf4b0 2020-11-20T12:14:25.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 -- 172.21.15.160:0/3326454938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bf4b0 msgr2=0x7f95d40bd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 --2- 172.21.15.160:0/3326454938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bf4b0 0x7f95d40bd8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f95d40c3fa0 tx=0x7f95cc009290).stop 2020-11-20T12:14:25.190 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 -- 172.21.15.160:0/3326454938 shutdown_connections 2020-11-20T12:14:25.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 --2- 172.21.15.160:0/3326454938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bf4b0 0x7f95d40bd8b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 --2- 172.21.15.160:0/3326454938 >> v2:172.21.15.150:3300/0 conn(0x7f95d40bc720 0x7f95d40bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 --2- 172.21.15.160:0/3326454938 >> v2:172.21.15.134:3300/0 conn(0x7f95d414f590 0x7f95d4065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 -- 172.21.15.160:0/3326454938 >> 172.21.15.160:0/3326454938 conn(0x7f95d4062ef0 msgr2=0x7f95d4063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:25.191 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 -- 172.21.15.160:0/3326454938 shutdown_connections 2020-11-20T12:14:25.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.182+0000 7f95d3fff700 1 -- 172.21.15.160:0/3326454938 wait complete. 2020-11-20T12:14:25.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.184+0000 7f95d3fff700 1 Processor -- start 2020-11-20T12:14:25.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.184+0000 7f95d3fff700 1 -- start start 2020-11-20T12:14:25.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bc720 0x7f95d4160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.192 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d40bf4b0 0x7f95d40c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.194 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95d414f590 0x7f95d41613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d3fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d41634a0 con 0x7f95d414f590 2020-11-20T12:14:25.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d3fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4160e60 con 0x7f95d40bf4b0 2020-11-20T12:14:25.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d3fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d4155db0 con 0x7f95d40bc720 2020-11-20T12:14:25.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bc720 0x7f95d4160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.196 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95d414f590 0x7f95d41613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.196 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bc720 0x7f95d4160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38174/0 (socket says 172.21.15.160:38174) 2020-11-20T12:14:25.196 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95d2ffd700 1 -- 172.21.15.160:0/2373107146 learned_addr learned my addr 172.21.15.160:0/2373107146 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:25.196 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.185+0000 7f95ca7fc700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d40bf4b0 0x7f95d40c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.196 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d37fe700 1 -- 172.21.15.160:0/2373107146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bc720 msgr2=0x7f95d4160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d37fe700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bc720 0x7f95d4160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d37fe700 1 -- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d40bf4b0 msgr2=0x7f95d40c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d37fe700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d40bf4b0 0x7f95d40c0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d37fe700 1 -- 172.21.15.160:0/2373107146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4156050 con 0x7f95d414f590 2020-11-20T12:14:25.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d2ffd700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bc720 0x7f95d4160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:25.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d37fe700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95d414f590 0x7f95d41613a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f95cc013000 tx=0x7f95cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:25.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95cb7fe700 1 -- 172.21.15.160:0/2373107146 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc00bba0 con 0x7f95d414f590 2020-11-20T12:14:25.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95cb7fe700 1 -- 172.21.15.160:0/2373107146 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc00be70 con 0x7f95d414f590 2020-11-20T12:14:25.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d41636d0 con 0x7f95d414f590 2020-11-20T12:14:25.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95cb7fe700 1 -- 172.21.15.160:0/2373107146 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc010d10 con 0x7f95d414f590 2020-11-20T12:14:25.199 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.186+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d4163c10 con 0x7f95d414f590 2020-11-20T12:14:25.199 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.187+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d4044f60 con 0x7f95d414f590 2020-11-20T12:14:25.199 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.189+0000 7f95cb7fe700 1 -- 172.21.15.160:0/2373107146 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f95cc023030 con 0x7f95d414f590 2020-11-20T12:14:25.199 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.190+0000 7f95cb7fe700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f95b0080630 0x7f95b0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.199 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.190+0000 7f95cb7fe700 1 -- 172.21.15.160:0/2373107146 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f95cc0a3c20 con 0x7f95d414f590 2020-11-20T12:14:25.200 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.190+0000 7f95d2ffd700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f95b0080630 0x7f95b0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.200 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.191+0000 7f95d2ffd700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f95b0080630 0x7f95b0082af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f95c4006a90 tx=0x7f95c4006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:25.200 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.192+0000 7f95cb7fe700 1 -- 172.21.15.160:0/2373107146 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f95cc078820 con 0x7f95d414f590 2020-11-20T12:14:25.380 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.376+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f95d4064530 con 0x7f95d414f590 2020-11-20T12:14:25.381 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.376+0000 7f95cb7fe700 1 -- 172.21.15.160:0/2373107146 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95cc021090 con 0x7f95d414f590 2020-11-20T12:14:25.381 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:25.383 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f95b0080630 msgr2=0x7f95b0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.384 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f95b0080630 0x7f95b0082af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f95c4006a90 tx=0x7f95c4006df0).stop 2020-11-20T12:14:25.384 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95d414f590 msgr2=0x7f95d41613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95d414f590 0x7f95d41613a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f95cc013000 tx=0x7f95cc016000).stop 2020-11-20T12:14:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 shutdown_connections 2020-11-20T12:14:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f95b0080630 0x7f95b0082af0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95d414f590 0x7f95d41613a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d40bc720 0x7f95d4160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.388 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 --2- 172.21.15.160:0/2373107146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f95d40bf4b0 0x7f95d40c0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 >> 172.21.15.160:0/2373107146 conn(0x7f95d4062ef0 msgr2=0x7f95d414dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:25.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 shutdown_connections 2020-11-20T12:14:25.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.379+0000 7f95d3fff700 1 -- 172.21.15.160:0/2373107146 wait complete. 2020-11-20T12:14:25.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444039 for osd.3 2020-11-20T12:14:25.407 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-20T12:14:25.674 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.670+0000 7f63ec969700 1 Processor -- start 2020-11-20T12:14:25.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.670+0000 7f63ec969700 1 -- start start 2020-11-20T12:14:25.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63ec969700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63e8151a90 0x7f63e80ba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63ec969700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f63e80bc740 0x7f63e814f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63ec969700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e814da40 con 0x7f63e80ba510 2020-11-20T12:14:25.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63ec969700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80bcbd0 con 0x7f63e8151a90 2020-11-20T12:14:25.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63ec969700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e814dce0 con 0x7f63e80bc740 2020-11-20T12:14:25.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63deffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63e8151a90 0x7f63e80ba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63e7fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f63e80bc740 0x7f63e814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63deffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f63e8151a90 0x7f63e80ba8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60706/0 (socket says 172.21.15.160:60706) 2020-11-20T12:14:25.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.672+0000 7f63deffd700 1 -- 172.21.15.160:0/1364354243 learned_addr learned my addr 172.21.15.160:0/1364354243 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:25.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63deffd700 1 -- 172.21.15.160:0/1364354243 >> v2:172.21.15.160:3300/0 conn(0x7f63e80bc740 msgr2=0x7f63e814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:25.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63deffd700 1 --2- 172.21.15.160:0/1364354243 >> v2:172.21.15.160:3300/0 conn(0x7f63e80bc740 0x7f63e814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63deffd700 1 -- 172.21.15.160:0/1364354243 >> v1:172.21.15.150:6789/0 conn(0x7f63e80ba510 legacy=0x7f63e80bc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63deffd700 1 -- 172.21.15.160:0/1364354243 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e814df80 con 0x7f63e8151a90 2020-11-20T12:14:25.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63deffd700 1 --2- 172.21.15.160:0/1364354243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e8151a90 0x7f63e80ba8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f63e8151ef0 tx=0x7f63d0006eb0).ready entity=mon.0 client_cookie=b387028ffb5932f7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:25.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63e6ffd700 1 -- 172.21.15.160:0/1364354243 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00098a0 con 0x7f63e8151a90 2020-11-20T12:14:25.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63e6ffd700 1 -- 172.21.15.160:0/1364354243 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0009a00 con 0x7f63e8151a90 2020-11-20T12:14:25.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.673+0000 7f63e6ffd700 1 -- 172.21.15.160:0/1364354243 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0009d80 con 0x7f63e8151a90 2020-11-20T12:14:25.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 -- 172.21.15.160:0/1364354243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e8151a90 msgr2=0x7f63e80ba8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 --2- 172.21.15.160:0/1364354243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e8151a90 0x7f63e80ba8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f63e8151ef0 tx=0x7f63d0006eb0).stop 2020-11-20T12:14:25.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 -- 172.21.15.160:0/1364354243 shutdown_connections 2020-11-20T12:14:25.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 --2- 172.21.15.160:0/1364354243 >> v2:172.21.15.160:3300/0 conn(0x7f63e80bc740 0x7f63e814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 --2- 172.21.15.160:0/1364354243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e8151a90 0x7f63e80ba8f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 -- 172.21.15.160:0/1364354243 >> 172.21.15.160:0/1364354243 conn(0x7f63e8062ef0 msgr2=0x7f63e8063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:25.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 -- 172.21.15.160:0/1364354243 shutdown_connections 2020-11-20T12:14:25.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.674+0000 7f63ec969700 1 -- 172.21.15.160:0/1364354243 wait complete. 2020-11-20T12:14:25.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.676+0000 7f63ec969700 1 Processor -- start 2020-11-20T12:14:25.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.676+0000 7f63ec969700 1 -- start start 2020-11-20T12:14:25.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63ec969700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63e80ba510 0x7f63e8161d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63ec969700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bc740 0x7f63e8152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63ec969700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e8151a90 0x7f63e810da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.691 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63ec969700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8155e30 con 0x7f63e80bc740 2020-11-20T12:14:25.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63ec969700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8152e90 con 0x7f63e8151a90 2020-11-20T12:14:25.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63ec969700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e81622c0 con 0x7f63e80ba510 2020-11-20T12:14:25.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63e80ba510 0x7f63e8161d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.692 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63e80ba510 0x7f63e8161d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38188/0 (socket says 172.21.15.160:38188) 2020-11-20T12:14:25.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63e7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e8151a90 0x7f63e810da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63e77fe700 1 -- 172.21.15.160:0/125664549 learned_addr learned my addr 172.21.15.160:0/125664549 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:25.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.678+0000 7f63deffd700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bc740 0x7f63e8152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63e77fe700 1 -- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e8151a90 msgr2=0x7f63e810da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63e77fe700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e8151a90 0x7f63e810da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63e77fe700 1 -- 172.21.15.160:0/125664549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bc740 msgr2=0x7f63e8152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63e77fe700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bc740 0x7f63e8152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63e77fe700 1 -- 172.21.15.160:0/125664549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80bd9a0 con 0x7f63e80ba510 2020-11-20T12:14:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63e77fe700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63e80ba510 0x7f63e8161d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f63d800c710 tx=0x7f63d8007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63dffff700 1 -- 172.21.15.160:0/125664549 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800e4a0 con 0x7f63e80ba510 2020-11-20T12:14:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63dffff700 1 -- 172.21.15.160:0/125664549 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800e600 con 0x7f63e80ba510 2020-11-20T12:14:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e80bde90 con 0x7f63e80ba510 2020-11-20T12:14:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63dffff700 1 -- 172.21.15.160:0/125664549 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800e9a0 con 0x7f63e80ba510 2020-11-20T12:14:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.679+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e80be670 con 0x7f63e80ba510 2020-11-20T12:14:25.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.680+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e8044f60 con 0x7f63e80ba510 2020-11-20T12:14:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.682+0000 7f63dffff700 1 -- 172.21.15.160:0/125664549 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f63d8010030 con 0x7f63e80ba510 2020-11-20T12:14:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.682+0000 7f63dffff700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f63c4080660 0x7f63c4082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.683+0000 7f63dffff700 1 -- 172.21.15.160:0/125664549 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f63d80a2550 con 0x7f63e80ba510 2020-11-20T12:14:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.683+0000 7f63deffd700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f63c4080660 0x7f63c4082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:25.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.683+0000 7f63deffd700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f63c4080660 0x7f63c4082b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f63e8151ef0 tx=0x7f63d0015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:25.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.686+0000 7f63dffff700 1 -- 172.21.15.160:0/125664549 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f63d8077150 con 0x7f63e80ba510 2020-11-20T12:14:25.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.871+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f63e8060d50 con 0x7f63e80ba510 2020-11-20T12:14:25.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.871+0000 7f63dffff700 1 -- 172.21.15.160:0/125664549 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63d8007d30 con 0x7f63e80ba510 2020-11-20T12:14:25.875 INFO:teuthology.orchestra.run.smithi160.stdout:73014444041 2020-11-20T12:14:25.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.873+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f63c4080660 msgr2=0x7f63c4082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.873+0000 7f63ec969700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f63c4080660 0x7f63c4082b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f63e8151ef0 tx=0x7f63d0015000).stop 2020-11-20T12:14:25.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.873+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63e80ba510 msgr2=0x7f63e8161d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:25.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.873+0000 7f63ec969700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63e80ba510 0x7f63e8161d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f63d800c710 tx=0x7f63d8007c10).stop 2020-11-20T12:14:25.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 shutdown_connections 2020-11-20T12:14:25.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f63c4080660 0x7f63c4082b20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f63e8151a90 0x7f63e810da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63e80ba510 0x7f63e8161d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 --2- 172.21.15.160:0/125664549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e80bc740 0x7f63e8152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:25.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 >> 172.21.15.160:0/125664549 conn(0x7f63e8062ef0 msgr2=0x7f63e81482f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:25.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 shutdown_connections 2020-11-20T12:14:25.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:25.874+0000 7f63ec969700 1 -- 172.21.15.160:0/125664549 wait complete. 2020-11-20T12:14:25.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444041 for osd.4 2020-11-20T12:14:25.904 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-20T12:14:26.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.150+0000 7f781bfff700 1 Processor -- start 2020-11-20T12:14:26.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.151+0000 7f781bfff700 1 -- start start 2020-11-20T12:14:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.152+0000 7f781bfff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f781c0bfa60 0x7f781c0bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.152+0000 7f781bfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f781c1555c0 0x7f781c155a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.152+0000 7f781bfff700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c155160 con 0x7f781c154400 2020-11-20T12:14:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.152+0000 7f781bfff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c155f60 con 0x7f781c0bfa60 2020-11-20T12:14:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.152+0000 7f781bfff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c063c20 con 0x7f781c1555c0 2020-11-20T12:14:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.152+0000 7f781b7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f781c154400 0x7f781c154890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55776/0 (socket says 172.21.15.160:55776) 2020-11-20T12:14:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f781b7fe700 1 -- 172.21.15.160:0/3273503073 learned_addr learned my addr 172.21.15.160:0/3273503073 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f781affd700 1 --2- 172.21.15.160:0/3273503073 >> v2:172.21.15.134:3300/0 conn(0x7f781c0bfa60 0x7f781c0bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f78127fc700 1 --2- 172.21.15.160:0/3273503073 >> v2:172.21.15.150:3300/0 conn(0x7f781c1555c0 0x7f781c155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f78127fc700 1 -- 172.21.15.160:0/3273503073 >> v2:172.21.15.134:3300/0 conn(0x7f781c0bfa60 msgr2=0x7f781c0bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:26.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f781a7fc700 1 -- 172.21.15.160:0/3273503073 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290198510 0 0) 0x7f781c155160 con 0x7f781c154400 2020-11-20T12:14:26.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f78127fc700 1 --2- 172.21.15.160:0/3273503073 >> v2:172.21.15.134:3300/0 conn(0x7f781c0bfa60 0x7f781c0bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f78127fc700 1 -- 172.21.15.160:0/3273503073 >> v1:172.21.15.160:6789/0 conn(0x7f781c154400 legacy=0x7f781c154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f78127fc700 1 -- 172.21.15.160:0/3273503073 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c158a00 con 0x7f781c1555c0 2020-11-20T12:14:26.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.153+0000 7f781affd700 1 --2- 172.21.15.160:0/3273503073 >> v2:172.21.15.134:3300/0 conn(0x7f781c0bfa60 0x7f781c0bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f78127fc700 1 --2- 172.21.15.160:0/3273503073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c1555c0 0x7f781c155a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f781c111a70 tx=0x7f7804006df0).ready entity=mon.1 client_cookie=9fea896f3e22384f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781a7fc700 1 -- 172.21.15.160:0/3273503073 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78040097b0 con 0x7f781c1555c0 2020-11-20T12:14:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781a7fc700 1 -- 172.21.15.160:0/3273503073 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7804009910 con 0x7f781c1555c0 2020-11-20T12:14:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781a7fc700 1 -- 172.21.15.160:0/3273503073 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804009c90 con 0x7f781c1555c0 2020-11-20T12:14:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781bfff700 1 -- 172.21.15.160:0/3273503073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c1555c0 msgr2=0x7f781c155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781bfff700 1 --2- 172.21.15.160:0/3273503073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c1555c0 0x7f781c155a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f781c111a70 tx=0x7f7804006df0).stop 2020-11-20T12:14:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781bfff700 1 -- 172.21.15.160:0/3273503073 shutdown_connections 2020-11-20T12:14:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781bfff700 1 --2- 172.21.15.160:0/3273503073 >> v2:172.21.15.134:3300/0 conn(0x7f781c0bfa60 0x7f781c0bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781bfff700 1 --2- 172.21.15.160:0/3273503073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c1555c0 0x7f781c155a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.154+0000 7f781bfff700 1 -- 172.21.15.160:0/3273503073 >> 172.21.15.160:0/3273503073 conn(0x7f781c062ef0 msgr2=0x7f781c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.155+0000 7f781bfff700 1 -- 172.21.15.160:0/3273503073 shutdown_connections 2020-11-20T12:14:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.155+0000 7f781bfff700 1 -- 172.21.15.160:0/3273503073 wait complete. 2020-11-20T12:14:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.156+0000 7f781bfff700 1 Processor -- start 2020-11-20T12:14:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.156+0000 7f781bfff700 1 -- start start 2020-11-20T12:14:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.157+0000 7f781bfff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c0bfa60 0x7f781c164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.157+0000 7f781bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c154400 0x7f781c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.157+0000 7f781bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f781c1555c0 0x7f781c14d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.157+0000 7f781bfff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c164c00 con 0x7f781c154400 2020-11-20T12:14:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.157+0000 7f781bfff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c164ea0 con 0x7f781c0bfa60 2020-11-20T12:14:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.157+0000 7f781bfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c165140 con 0x7f781c1555c0 2020-11-20T12:14:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f781c1555c0 0x7f781c14d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c0bfa60 0x7f781c164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c0bfa60 0x7f781c164540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51338/0 (socket says 172.21.15.160:51338) 2020-11-20T12:14:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 -- 172.21.15.160:0/2342714015 learned_addr learned my addr 172.21.15.160:0/2342714015 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:26.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f78127fc700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c154400 0x7f781c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 -- 172.21.15.160:0/2342714015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f781c1555c0 msgr2=0x7f781c14d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f781c1555c0 0x7f781c14d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 -- 172.21.15.160:0/2342714015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c154400 msgr2=0x7f781c1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c154400 0x7f781c1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 -- 172.21.15.160:0/2342714015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c1653e0 con 0x7f781c0bfa60 2020-11-20T12:14:26.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f78127fc700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c154400 0x7f781c1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:26.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f781affd700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c0bfa60 0x7f781c164540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f780c00ef50 tx=0x7f780c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:26.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.158+0000 7f78137fe700 1 -- 172.21.15.160:0/2342714015 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00cb10 con 0x7f781c0bfa60 2020-11-20T12:14:26.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.159+0000 7f78137fe700 1 -- 172.21.15.160:0/2342714015 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c00cc70 con 0x7f781c0bfa60 2020-11-20T12:14:26.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.159+0000 7f78137fe700 1 -- 172.21.15.160:0/2342714015 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c0123f0 con 0x7f781c0bfa60 2020-11-20T12:14:26.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.159+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c14fdf0 con 0x7f781c0bfa60 2020-11-20T12:14:26.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.159+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c14e0f0 con 0x7f781c0bfa60 2020-11-20T12:14:26.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.160+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781c044f60 con 0x7f781c0bfa60 2020-11-20T12:14:26.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.161+0000 7f78137fe700 1 -- 172.21.15.160:0/2342714015 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f780c012760 con 0x7f781c0bfa60 2020-11-20T12:14:26.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.162+0000 7f78137fe700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f77f8080630 0x7f77f8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.162+0000 7f78137fe700 1 -- 172.21.15.160:0/2342714015 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f780c0a2ef0 con 0x7f781c0bfa60 2020-11-20T12:14:26.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.162+0000 7f78127fc700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f77f8080630 0x7f77f8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.163+0000 7f78127fc700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f77f8080630 0x7f77f8082af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7804006e30 tx=0x7f7804015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:26.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.165+0000 7f78137fe700 1 -- 172.21.15.160:0/2342714015 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f780c077af0 con 0x7f781c0bfa60 2020-11-20T12:14:26.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.351+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f781c158540 con 0x7f781c0bfa60 2020-11-20T12:14:26.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.352+0000 7f78137fe700 1 -- 172.21.15.160:0/2342714015 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f780c07b110 con 0x7f781c0bfa60 2020-11-20T12:14:26.355 INFO:teuthology.orchestra.run.smithi160.stdout:73014444040 2020-11-20T12:14:26.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f77f8080630 msgr2=0x7f77f8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f77f8080630 0x7f77f8082af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f7804006e30 tx=0x7f7804015000).stop 2020-11-20T12:14:26.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c0bfa60 msgr2=0x7f781c164540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c0bfa60 0x7f781c164540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f780c00ef50 tx=0x7f780c006df0).stop 2020-11-20T12:14:26.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 shutdown_connections 2020-11-20T12:14:26.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f77f8080630 0x7f77f8082af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f781c1555c0 0x7f781c14d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f781c0bfa60 0x7f781c164540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 --2- 172.21.15.160:0/2342714015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f781c154400 0x7f781c1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.354+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 >> 172.21.15.160:0/2342714015 conn(0x7f781c062ef0 msgr2=0x7f781c064960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:26.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.355+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 shutdown_connections 2020-11-20T12:14:26.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.355+0000 7f781bfff700 1 -- 172.21.15.160:0/2342714015 wait complete. 2020-11-20T12:14:26.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.5 2020-11-20T12:14:26.383 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-20T12:14:26.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.632+0000 7f662889d700 1 Processor -- start 2020-11-20T12:14:26.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.632+0000 7f662889d700 1 -- start start 2020-11-20T12:14:26.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f662889d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6624062980 0x7f6624062d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f662889d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6624151900 0x7f66240bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f662889d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662414db10 con 0x7f66240bc380 2020-11-20T12:14:26.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f662889d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662414ddb0 con 0x7f6624151900 2020-11-20T12:14:26.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f662889d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662414e050 con 0x7f6624062980 2020-11-20T12:14:26.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f6622ffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6624151900 0x7f66240bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f66237fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6624062980 0x7f6624062d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f6622ffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6624151900 0x7f66240bbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60732/0 (socket says 172.21.15.160:60732) 2020-11-20T12:14:26.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.634+0000 7f6622ffd700 1 -- 172.21.15.160:0/2049067610 learned_addr learned my addr 172.21.15.160:0/2049067610 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:26.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f6622ffd700 1 -- 172.21.15.160:0/2049067610 >> v2:172.21.15.160:3300/0 conn(0x7f6624062980 msgr2=0x7f6624062d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:26.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f6622ffd700 1 --2- 172.21.15.160:0/2049067610 >> v2:172.21.15.160:3300/0 conn(0x7f6624062980 0x7f6624062d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f6622ffd700 1 -- 172.21.15.160:0/2049067610 >> v1:172.21.15.160:6789/0 conn(0x7f66240bc380 legacy=0x7f662414a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f6622ffd700 1 -- 172.21.15.160:0/2049067610 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662414e2f0 con 0x7f6624151900 2020-11-20T12:14:26.643 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f66237fe700 1 --2- 172.21.15.160:0/2049067610 >> v2:172.21.15.160:3300/0 conn(0x7f6624062980 0x7f6624062d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:26.643 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f6622ffd700 1 --2- 172.21.15.160:0/2049067610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f66240bbe90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6624044880 tx=0x7f6618006eb0).ready entity=mon.0 client_cookie=f052b17048b7a4ab server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:26.643 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f66227fc700 1 -- 172.21.15.160:0/2049067610 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618009960 con 0x7f6624151900 2020-11-20T12:14:26.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f66227fc700 1 -- 172.21.15.160:0/2049067610 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6618009ac0 con 0x7f6624151900 2020-11-20T12:14:26.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.635+0000 7f66227fc700 1 -- 172.21.15.160:0/2049067610 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618009e40 con 0x7f6624151900 2020-11-20T12:14:26.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 -- 172.21.15.160:0/2049067610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 msgr2=0x7f66240bbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 --2- 172.21.15.160:0/2049067610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f66240bbe90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f6624044880 tx=0x7f6618006eb0).stop 2020-11-20T12:14:26.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 -- 172.21.15.160:0/2049067610 shutdown_connections 2020-11-20T12:14:26.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 --2- 172.21.15.160:0/2049067610 >> v2:172.21.15.160:3300/0 conn(0x7f6624062980 0x7f6624062d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 --2- 172.21.15.160:0/2049067610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f66240bbe90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 -- 172.21.15.160:0/2049067610 >> 172.21.15.160:0/2049067610 conn(0x7f66240c4010 msgr2=0x7f66240c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:26.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 -- 172.21.15.160:0/2049067610 shutdown_connections 2020-11-20T12:14:26.646 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.636+0000 7f662889d700 1 -- 172.21.15.160:0/2049067610 wait complete. 2020-11-20T12:14:26.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.638+0000 7f662889d700 1 Processor -- start 2020-11-20T12:14:26.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.638+0000 7f662889d700 1 -- start start 2020-11-20T12:14:26.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.639+0000 7f662889d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6624062980 0x7f6624137d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.639+0000 7f662889d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66240bc380 0x7f662413aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.639+0000 7f662889d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f6624141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.639+0000 7f662889d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6624138230 con 0x7f6624151900 2020-11-20T12:14:26.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.639+0000 7f662889d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662414ff10 con 0x7f6624062980 2020-11-20T12:14:26.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.639+0000 7f662889d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66241501b0 con 0x7f66240bc380 2020-11-20T12:14:26.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6623fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f6624141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6622ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66240bc380 0x7f662413aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6623fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f6624141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60740/0 (socket says 172.21.15.160:60740) 2020-11-20T12:14:26.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6623fff700 1 -- 172.21.15.160:0/161023015 learned_addr learned my addr 172.21.15.160:0/161023015 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:26.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f66237fe700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6624062980 0x7f6624137d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6622ffd700 1 -- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6624062980 msgr2=0x7f6624137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6622ffd700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6624062980 0x7f6624137d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6622ffd700 1 -- 172.21.15.160:0/161023015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 msgr2=0x7f6624141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6622ffd700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f6624141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6622ffd700 1 -- 172.21.15.160:0/161023015 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624141430 con 0x7f66240bc380 2020-11-20T12:14:26.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.640+0000 7f6622ffd700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66240bc380 0x7f662413aba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6618012000 tx=0x7f6618015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:26.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.641+0000 7f66037fe700 1 -- 172.21.15.160:0/161023015 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618011d50 con 0x7f66240bc380 2020-11-20T12:14:26.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.641+0000 7f66037fe700 1 -- 172.21.15.160:0/161023015 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661801e460 con 0x7f66240bc380 2020-11-20T12:14:26.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.641+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66241416d0 con 0x7f66240bc380 2020-11-20T12:14:26.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.641+0000 7f66037fe700 1 -- 172.21.15.160:0/161023015 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661801e7e0 con 0x7f66240bc380 2020-11-20T12:14:26.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.641+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6624138b80 con 0x7f66240bc380 2020-11-20T12:14:26.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.642+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6624141b30 con 0x7f66240bc380 2020-11-20T12:14:26.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.643+0000 7f66037fe700 1 -- 172.21.15.160:0/161023015 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f661801a040 con 0x7f66240bc380 2020-11-20T12:14:26.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.644+0000 7f66037fe700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f65fc080630 0x7f65fc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:26.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.644+0000 7f66037fe700 1 -- 172.21.15.160:0/161023015 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f66180a3c80 con 0x7f66240bc380 2020-11-20T12:14:26.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.644+0000 7f66237fe700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f65fc080630 0x7f65fc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:26.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.645+0000 7f66237fe700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f65fc080630 0x7f65fc082af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f661400ba80 tx=0x7f6614008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:26.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.648+0000 7f66037fe700 1 -- 172.21.15.160:0/161023015 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6618078880 con 0x7f66240bc380 2020-11-20T12:14:26.837 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.834+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6624044f60 con 0x7f66240bc380 2020-11-20T12:14:26.838 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.834+0000 7f66037fe700 1 -- 172.21.15.160:0/161023015 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6618023070 con 0x7f66240bc380 2020-11-20T12:14:26.838 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:26.840 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f65fc080630 msgr2=0x7f65fc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.840 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f65fc080630 0x7f65fc082af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f661400ba80 tx=0x7f6614008040).stop 2020-11-20T12:14:26.840 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66240bc380 msgr2=0x7f662413aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:26.841 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66240bc380 0x7f662413aba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6618012000 tx=0x7f6618015000).stop 2020-11-20T12:14:26.841 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 shutdown_connections 2020-11-20T12:14:26.841 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f65fc080630 0x7f65fc082af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.842 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6624151900 0x7f6624141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.842 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6624062980 0x7f6624137d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.842 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 --2- 172.21.15.160:0/161023015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66240bc380 0x7f662413aba0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:26.842 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 >> 172.21.15.160:0/161023015 conn(0x7f66240c4010 msgr2=0x7f66240c0970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:26.843 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 shutdown_connections 2020-11-20T12:14:26.843 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:26.837+0000 7f662889d700 1 -- 172.21.15.160:0/161023015 wait complete. 2020-11-20T12:14:26.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444039 for osd.6 2020-11-20T12:14:26.865 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-20T12:14:27.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.092+0000 7fe1b0931700 1 Processor -- start 2020-11-20T12:14:27.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.092+0000 7fe1b0931700 1 -- start start 2020-11-20T12:14:27.097 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1b0931700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe1ac155cd0 0x7fe1ac0bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1b0931700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fe1ac154400 0x7fe1ac154890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1b0931700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac155160 con 0x7fe1ac0bfa60 2020-11-20T12:14:27.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1b0931700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac063c20 con 0x7fe1ac154400 2020-11-20T12:14:27.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1b0931700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac158a00 con 0x7fe1ac155cd0 2020-11-20T12:14:27.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1aaffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe1ac155cd0 0x7fe1ac0bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1aaffd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe1ac155cd0 0x7fe1ac0bfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38224/0 (socket says 172.21.15.160:38224) 2020-11-20T12:14:27.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1aaffd700 1 -- 172.21.15.160:0/3933978184 learned_addr learned my addr 172.21.15.160:0/3933978184 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:27.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1ab7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fe1ac0bfa60 0x7fe1ac1555c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47070/0 (socket says 172.21.15.160:47070) 2020-11-20T12:14:27.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.094+0000 7fe1abfff700 1 --2- 172.21.15.160:0/3933978184 >> v2:172.21.15.134:3300/0 conn(0x7fe1ac154400 0x7fe1ac154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1aa7fc700 1 -- 172.21.15.160:0/3933978184 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201514070 0 0) 0x7fe1ac155160 con 0x7fe1ac0bfa60 2020-11-20T12:14:27.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1aaffd700 1 -- 172.21.15.160:0/3933978184 >> v2:172.21.15.134:3300/0 conn(0x7fe1ac154400 msgr2=0x7fe1ac154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:27.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1aaffd700 1 --2- 172.21.15.160:0/3933978184 >> v2:172.21.15.134:3300/0 conn(0x7fe1ac154400 0x7fe1ac154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1aaffd700 1 -- 172.21.15.160:0/3933978184 >> v1:172.21.15.150:6789/0 conn(0x7fe1ac0bfa60 legacy=0x7fe1ac1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1aaffd700 1 -- 172.21.15.160:0/3933978184 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac158ca0 con 0x7fe1ac155cd0 2020-11-20T12:14:27.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1abfff700 1 --2- 172.21.15.160:0/3933978184 >> v2:172.21.15.134:3300/0 conn(0x7fe1ac154400 0x7fe1ac154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:27.102 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1aaffd700 1 --2- 172.21.15.160:0/3933978184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac155cd0 0x7fe1ac0bfe40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe1a0006fd0 tx=0x7fe1a0006eb0).ready entity=mon.2 client_cookie=ae8f0c75a8bc7ab5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:27.104 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.095+0000 7fe1aa7fc700 1 -- 172.21.15.160:0/3933978184 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00097d0 con 0x7fe1ac155cd0 2020-11-20T12:14:27.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1aa7fc700 1 -- 172.21.15.160:0/3933978184 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0009930 con 0x7fe1ac155cd0 2020-11-20T12:14:27.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1aa7fc700 1 -- 172.21.15.160:0/3933978184 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0009cb0 con 0x7fe1ac155cd0 2020-11-20T12:14:27.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 -- 172.21.15.160:0/3933978184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac155cd0 msgr2=0x7fe1ac0bfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 --2- 172.21.15.160:0/3933978184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac155cd0 0x7fe1ac0bfe40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fe1a0006fd0 tx=0x7fe1a0006eb0).stop 2020-11-20T12:14:27.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 -- 172.21.15.160:0/3933978184 shutdown_connections 2020-11-20T12:14:27.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 --2- 172.21.15.160:0/3933978184 >> v2:172.21.15.134:3300/0 conn(0x7fe1ac154400 0x7fe1ac154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 --2- 172.21.15.160:0/3933978184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac155cd0 0x7fe1ac0bfe40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 -- 172.21.15.160:0/3933978184 >> 172.21.15.160:0/3933978184 conn(0x7fe1ac062ef0 msgr2=0x7fe1ac063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:27.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 -- 172.21.15.160:0/3933978184 shutdown_connections 2020-11-20T12:14:27.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.096+0000 7fe1b0931700 1 -- 172.21.15.160:0/3933978184 wait complete. 2020-11-20T12:14:27.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.098+0000 7fe1b0931700 1 Processor -- start 2020-11-20T12:14:27.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.098+0000 7fe1b0931700 1 -- start start 2020-11-20T12:14:27.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1b0931700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0bfa60 0x7fe1ac168320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1b0931700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ac154400 0x7fe1ac164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1b0931700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac155cd0 0x7fe1ac0bb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1b0931700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac10e480 con 0x7fe1ac155cd0 2020-11-20T12:14:27.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1b0931700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1651b0 con 0x7fe1ac154400 2020-11-20T12:14:27.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1b0931700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac10df40 con 0x7fe1ac0bfa60 2020-11-20T12:14:27.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1ab7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0bfa60 0x7fe1ac168320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1aaffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ac154400 0x7fe1ac164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1ab7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0bfa60 0x7fe1ac168320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38230/0 (socket says 172.21.15.160:38230) 2020-11-20T12:14:27.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1ab7fe700 1 -- 172.21.15.160:0/2544143501 learned_addr learned my addr 172.21.15.160:0/2544143501 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:27.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.099+0000 7fe1abfff700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac155cd0 0x7fe1ac0bb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe1aaffd700 1 -- 172.21.15.160:0/2544143501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0bfa60 msgr2=0x7fe1ac168320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe1aaffd700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0bfa60 0x7fe1ac168320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe1aaffd700 1 -- 172.21.15.160:0/2544143501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac155cd0 msgr2=0x7fe1ac0bb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe1aaffd700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac155cd0 0x7fe1ac0bb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe1aaffd700 1 -- 172.21.15.160:0/2544143501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac10e1e0 con 0x7fe1ac154400 2020-11-20T12:14:27.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe1aaffd700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ac154400 0x7fe1ac164cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fe1a0006fd0 tx=0x7fe1a0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:27.111 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe18b7fe700 1 -- 172.21.15.160:0/2544143501 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0011e50 con 0x7fe1ac154400 2020-11-20T12:14:27.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe18b7fe700 1 -- 172.21.15.160:0/2544143501 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a001e460 con 0x7fe1ac154400 2020-11-20T12:14:27.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac167940 con 0x7fe1ac154400 2020-11-20T12:14:27.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.100+0000 7fe18b7fe700 1 -- 172.21.15.160:0/2544143501 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a001e7e0 con 0x7fe1ac154400 2020-11-20T12:14:27.112 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.101+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac167e80 con 0x7fe1ac154400 2020-11-20T12:14:27.113 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.102+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac168010 con 0x7fe1ac154400 2020-11-20T12:14:27.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.103+0000 7fe18b7fe700 1 -- 172.21.15.160:0/2544143501 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe1a0025030 con 0x7fe1ac154400 2020-11-20T12:14:27.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.104+0000 7fe18b7fe700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe184080630 0x7fe184082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.104+0000 7fe18b7fe700 1 -- 172.21.15.160:0/2544143501 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fe1a00a3e20 con 0x7fe1ac154400 2020-11-20T12:14:27.114 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.104+0000 7fe1ab7fe700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe184080630 0x7fe184082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.104+0000 7fe1ab7fe700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe184080630 0x7fe184082af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe19c007520 tx=0x7fe19c007a60).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:27.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.108+0000 7fe18b7fe700 1 -- 172.21.15.160:0/2544143501 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe1a0078a20 con 0x7fe1ac154400 2020-11-20T12:14:27.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.290+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe1ac044f60 con 0x7fe1ac154400 2020-11-20T12:14:27.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.291+0000 7fe18b7fe700 1 -- 172.21.15.160:0/2544143501 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1a0023070 con 0x7fe1ac154400 2020-11-20T12:14:27.294 INFO:teuthology.orchestra.run.smithi160.stdout:73014444040 2020-11-20T12:14:27.297 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe184080630 msgr2=0x7fe184082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.297 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe184080630 0x7fe184082af0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fe19c007520 tx=0x7fe19c007a60).stop 2020-11-20T12:14:27.297 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ac154400 msgr2=0x7fe1ac164cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.298 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ac154400 0x7fe1ac164cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fe1a0006fd0 tx=0x7fe1a0015000).stop 2020-11-20T12:14:27.298 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 shutdown_connections 2020-11-20T12:14:27.298 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe184080630 0x7fe184082af0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.298 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1ac155cd0 0x7fe1ac0bb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.298 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1ac0bfa60 0x7fe1ac168320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.299 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 --2- 172.21.15.160:0/2544143501 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1ac154400 0x7fe1ac164cc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.299 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 >> 172.21.15.160:0/2544143501 conn(0x7fe1ac062ef0 msgr2=0x7fe1ac064960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:27.299 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.293+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 shutdown_connections 2020-11-20T12:14:27.299 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.294+0000 7fe1b0931700 1 -- 172.21.15.160:0/2544143501 wait complete. 2020-11-20T12:14:27.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.7 2020-11-20T12:14:27.319 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2020-11-20T12:14:27.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.555+0000 7ff2fcb30700 1 Processor -- start 2020-11-20T12:14:27.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.555+0000 7ff2fcb30700 1 -- start start 2020-11-20T12:14:27.560 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.557+0000 7ff2fcb30700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80c0260 con 0x7ff2f8151380 2020-11-20T12:14:27.560 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.557+0000 7ff2fcb30700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80bb600 con 0x7ff2f80bfe00 2020-11-20T12:14:27.561 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.557+0000 7ff2fcb30700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f80bb890 con 0x7ff2f80bfa20 2020-11-20T12:14:27.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.557+0000 7ff2f77fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7ff2f80bfa20 0x7ff2f80baef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55818/0 (socket says 172.21.15.160:55818) 2020-11-20T12:14:27.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.557+0000 7ff2eeffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff2f80bfe00 0x7ff2f8150c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47082/0 (socket says 172.21.15.160:47082) 2020-11-20T12:14:27.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.557+0000 7ff2f77fe700 1 -- 172.21.15.160:0/585108900 learned_addr learned my addr 172.21.15.160:0/585108900 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:27.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899457328 0 0) 0x7ff2f80bb600 con 0x7ff2f80bfe00 2020-11-20T12:14:27.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d8003240 con 0x7ff2f80bfe00 2020-11-20T12:14:27.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969968524 0 0) 0x7ff2f80bb890 con 0x7ff2f80bfa20 2020-11-20T12:14:27.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f80bb600 con 0x7ff2f80bfa20 2020-11-20T12:14:27.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707594047 0 0) 0x7ff2f00010d0 con 0x7ff2f8151380 2020-11-20T12:14:27.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f80bb890 con 0x7ff2f8151380 2020-11-20T12:14:27.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.2 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3348630519 0 0) 0x7ff2f80bb600 con 0x7ff2f80bfa20 2020-11-20T12:14:27.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 >> v1:172.21.15.150:6789/0 conn(0x7ff2f80bfe00 legacy=0x7ff2f8150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 >> v1:172.21.15.134:6789/0 conn(0x7ff2f8151380 legacy=0x7ff2f814dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f81543e0 con 0x7ff2f80bfa20 2020-11-20T12:14:27.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.2 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7ff2e8001840 con 0x7ff2f80bfa20 2020-11-20T12:14:27.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 >> v1:172.21.15.160:6789/0 conn(0x7ff2f80bfa20 legacy=0x7ff2f80baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.566 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8003aa0 0x7ff2d8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.558+0000 7ff2f6ffd700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2d80044e0 0x7ff2d8004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f6ffd700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2d800b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d800bcc0 con 0x7ff2d8003aa0 2020-11-20T12:14:27.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d800be30 con 0x7ff2d8004fb0 2020-11-20T12:14:27.567 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d800bff0 con 0x7ff2d80044e0 2020-11-20T12:14:27.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f77fe700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8003aa0 0x7ff2d8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2d800b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2eeffd700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2d80044e0 0x7ff2d8004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 -- 172.21.15.160:0/585108900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2d80044e0 msgr2=0x7ff2d8004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:27.568 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2d80044e0 0x7ff2d8004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.569 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 -- 172.21.15.160:0/585108900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8003aa0 msgr2=0x7ff2d8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:27.569 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8003aa0 0x7ff2d8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.569 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 -- 172.21.15.160:0/585108900 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f80bb600 con 0x7ff2d8004fb0 2020-11-20T12:14:27.569 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f77fe700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2d8003aa0 0x7ff2d8003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:27.570 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 -- 172.21.15.160:0/585108900 reap_dead start 2020-11-20T12:14:27.570 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.559+0000 7ff2f7fff700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2d800b730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff2f0007c60 tx=0x7ff2f0001b10).ready entity=mon.1 client_cookie=c030e70d1461c663 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:27.570 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f000c8f0 con 0x7ff2d8004fb0 2020-11-20T12:14:27.570 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f000ca50 con 0x7ff2d8004fb0 2020-11-20T12:14:27.571 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2f6ffd700 1 -- 172.21.15.160:0/585108900 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f000cdd0 con 0x7ff2d8004fb0 2020-11-20T12:14:27.573 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2fcb30700 1 -- 172.21.15.160:0/585108900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 msgr2=0x7ff2d800b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.574 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2d800b730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7ff2f0007c60 tx=0x7ff2f0001b10).stop 2020-11-20T12:14:27.574 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2fcb30700 1 -- 172.21.15.160:0/585108900 shutdown_connections 2020-11-20T12:14:27.574 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/585108900 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2d800b730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.574 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2fcb30700 1 -- 172.21.15.160:0/585108900 >> 172.21.15.160:0/585108900 conn(0x7ff2f8062ef0 msgr2=0x7ff2f8063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:27.574 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.560+0000 7ff2fcb30700 1 -- 172.21.15.160:0/585108900 shutdown_connections 2020-11-20T12:14:27.575 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.561+0000 7ff2fcb30700 1 -- 172.21.15.160:0/585108900 wait complete. 2020-11-20T12:14:27.575 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.562+0000 7ff2fcb30700 1 Processor -- start 2020-11-20T12:14:27.575 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.562+0000 7ff2fcb30700 1 -- start start 2020-11-20T12:14:27.575 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2fcb30700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2f80c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2fcb30700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f80c24d0 0x7ff2f814f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2fcb30700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f8157820 0x7ff2f8143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2fcb30700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f80c3e70 con 0x7ff2f80c24d0 2020-11-20T12:14:27.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2fcb30700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f814d3b0 con 0x7ff2d8004fb0 2020-11-20T12:14:27.576 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2fcb30700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f814fd00 con 0x7ff2f8157820 2020-11-20T12:14:27.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2eeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f80c24d0 0x7ff2f814f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2eeffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f80c24d0 0x7ff2f814f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60774/0 (socket says 172.21.15.160:60774) 2020-11-20T12:14:27.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2f7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f8157820 0x7ff2f8143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2eeffd700 1 -- 172.21.15.160:0/2369176081 learned_addr learned my addr 172.21.15.160:0/2369176081 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:27.577 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.563+0000 7ff2f77fe700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2f80c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2eeffd700 1 -- 172.21.15.160:0/2369176081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f8157820 msgr2=0x7ff2f8143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2eeffd700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f8157820 0x7ff2f8143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2eeffd700 1 -- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 msgr2=0x7ff2f80c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.578 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2eeffd700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2f80c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2eeffd700 1 -- 172.21.15.160:0/2369176081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f814d5e0 con 0x7ff2f80c24d0 2020-11-20T12:14:27.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2eeffd700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f80c24d0 0x7ff2f814f560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff2e0001680 tx=0x7ff2e0007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:27.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2effff700 1 -- 172.21.15.160:0/2369176081 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011580 con 0x7ff2f80c24d0 2020-11-20T12:14:27.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2effff700 1 -- 172.21.15.160:0/2369176081 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00116e0 con 0x7ff2f80c24d0 2020-11-20T12:14:27.579 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f814d880 con 0x7ff2f80c24d0 2020-11-20T12:14:27.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2effff700 1 -- 172.21.15.160:0/2369176081 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0011aa0 con 0x7ff2f80c24d0 2020-11-20T12:14:27.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.564+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f814ddc0 con 0x7ff2f80c24d0 2020-11-20T12:14:27.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.565+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f814fab0 con 0x7ff2f80c24d0 2020-11-20T12:14:27.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.567+0000 7ff2effff700 1 -- 172.21.15.160:0/2369176081 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff2e001b030 con 0x7ff2f80c24d0 2020-11-20T12:14:27.580 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.568+0000 7ff2effff700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff2d4080630 0x7ff2d4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:27.581 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.568+0000 7ff2effff700 1 -- 172.21.15.160:0/2369176081 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7ff2e00a2310 con 0x7ff2f80c24d0 2020-11-20T12:14:27.581 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.568+0000 7ff2f77fe700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff2d4080630 0x7ff2d4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:27.581 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.568+0000 7ff2f77fe700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff2d4080630 0x7ff2d4082af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff2e8007b20 tx=0x7ff2f80bba20).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:27.581 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.570+0000 7ff2effff700 1 -- 172.21.15.160:0/2369176081 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff2e0076f10 con 0x7ff2f80c24d0 2020-11-20T12:14:27.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.746+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7ff2f8044f60 con 0x7ff2f80c24d0 2020-11-20T12:14:27.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.747+0000 7ff2effff700 1 -- 172.21.15.160:0/2369176081 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff2e0019030 con 0x7ff2f80c24d0 2020-11-20T12:14:27.750 INFO:teuthology.orchestra.run.smithi160.stdout:73014444041 2020-11-20T12:14:27.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff2d4080630 msgr2=0x7ff2d4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff2d4080630 0x7ff2d4082af0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff2e8007b20 tx=0x7ff2f80bba20).stop 2020-11-20T12:14:27.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f80c24d0 msgr2=0x7ff2f814f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:27.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f80c24d0 0x7ff2f814f560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7ff2e0001680 tx=0x7ff2e0007b80).stop 2020-11-20T12:14:27.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 shutdown_connections 2020-11-20T12:14:27.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff2d4080630 0x7ff2d4082af0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2f8157820 0x7ff2f8143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2d8004fb0 0x7ff2f80c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 --2- 172.21.15.160:0/2369176081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2f80c24d0 0x7ff2f814f560 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:27.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 >> 172.21.15.160:0/2369176081 conn(0x7ff2f8062ef0 msgr2=0x7ff2f80656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:27.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 shutdown_connections 2020-11-20T12:14:27.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:27.749+0000 7ff2fcb30700 1 -- 172.21.15.160:0/2369176081 wait complete. 2020-11-20T12:14:27.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444041 for osd.8 2020-11-20T12:14:27.773 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2020-11-20T12:14:28.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.013+0000 7f2e73fff700 1 Processor -- start 2020-11-20T12:14:28.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.013+0000 7f2e73fff700 1 -- start start 2020-11-20T12:14:28.018 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.015+0000 7f2e73fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2e740bc720 0x7f2e740bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.019 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.015+0000 7f2e73fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2e7414f590 0x7f2e74065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.019 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.015+0000 7f2e73fff700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7414ebf0 con 0x7f2e740bf4b0 2020-11-20T12:14:28.019 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.015+0000 7f2e73fff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e74065eb0 con 0x7f2e740bc720 2020-11-20T12:14:28.019 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.015+0000 7f2e73fff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7414f9f0 con 0x7f2e7414f590 2020-11-20T12:14:28.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.016+0000 7f2e72ffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2e740bc720 0x7f2e740bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.016+0000 7f2e6a7fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2e7414f590 0x7f2e74065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.016+0000 7f2e72ffd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2e740bc720 0x7f2e740bcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60780/0 (socket says 172.21.15.160:60780) 2020-11-20T12:14:28.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.016+0000 7f2e72ffd700 1 -- 172.21.15.160:0/2177640341 learned_addr learned my addr 172.21.15.160:0/2177640341 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:28.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e6a7fc700 1 -- 172.21.15.160:0/2177640341 >> v2:172.21.15.134:3300/0 conn(0x7f2e740bc720 msgr2=0x7f2e740bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e6a7fc700 1 --2- 172.21.15.160:0/2177640341 >> v2:172.21.15.134:3300/0 conn(0x7f2e740bc720 0x7f2e740bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e727fc700 1 -- 172.21.15.160:0/2177640341 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154755769 0 0) 0x7f2e7414ebf0 con 0x7f2e740bf4b0 2020-11-20T12:14:28.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e6a7fc700 1 -- 172.21.15.160:0/2177640341 >> v1:172.21.15.160:6789/0 conn(0x7f2e740bf4b0 legacy=0x7f2e740bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e6a7fc700 1 -- 172.21.15.160:0/2177640341 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740656f0 con 0x7f2e7414f590 2020-11-20T12:14:28.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e72ffd700 1 --2- 172.21.15.160:0/2177640341 >> v2:172.21.15.134:3300/0 conn(0x7f2e740bc720 0x7f2e740bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:28.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e6a7fc700 1 --2- 172.21.15.160:0/2177640341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7414f590 0x7f2e74065200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2e740bcff0 tx=0x7f2e5c006df0).ready entity=mon.2 client_cookie=6d9bdd3df1466699 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e727fc700 1 -- 172.21.15.160:0/2177640341 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c009840 con 0x7f2e7414f590 2020-11-20T12:14:28.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e727fc700 1 -- 172.21.15.160:0/2177640341 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0099a0 con 0x7f2e7414f590 2020-11-20T12:14:28.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.017+0000 7f2e727fc700 1 -- 172.21.15.160:0/2177640341 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c009d20 con 0x7f2e7414f590 2020-11-20T12:14:28.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.018+0000 7f2e73fff700 1 -- 172.21.15.160:0/2177640341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7414f590 msgr2=0x7f2e74065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.018+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2177640341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7414f590 0x7f2e74065200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2e740bcff0 tx=0x7f2e5c006df0).stop 2020-11-20T12:14:28.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.018+0000 7f2e73fff700 1 -- 172.21.15.160:0/2177640341 shutdown_connections 2020-11-20T12:14:28.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.018+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2177640341 >> v2:172.21.15.134:3300/0 conn(0x7f2e740bc720 0x7f2e740bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.018+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2177640341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e7414f590 0x7f2e74065200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.018+0000 7f2e73fff700 1 -- 172.21.15.160:0/2177640341 >> 172.21.15.160:0/2177640341 conn(0x7f2e74062ef0 msgr2=0x7f2e74063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.018+0000 7f2e73fff700 1 -- 172.21.15.160:0/2177640341 shutdown_connections 2020-11-20T12:14:28.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.019+0000 7f2e73fff700 1 -- 172.21.15.160:0/2177640341 wait complete. 2020-11-20T12:14:28.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.020+0000 7f2e73fff700 1 Processor -- start 2020-11-20T12:14:28.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.021+0000 7f2e73fff700 1 -- start start 2020-11-20T12:14:28.028 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e740bc720 0x7f2e740c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e740bf4b0 0x7f2e741454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e74144f30 0x7f2e741467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e73fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741460f0 con 0x7f2e740bf4b0 2020-11-20T12:14:28.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e73fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74161e70 con 0x7f2e740bc720 2020-11-20T12:14:28.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e73fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74162110 con 0x7f2e74144f30 2020-11-20T12:14:28.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e74144f30 0x7f2e741467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e6a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e740bf4b0 0x7f2e741454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e74144f30 0x7f2e741467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38266/0 (socket says 172.21.15.160:38266) 2020-11-20T12:14:28.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e737fe700 1 -- 172.21.15.160:0/2045639439 learned_addr learned my addr 172.21.15.160:0/2045639439 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:28.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e6a7fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e740bf4b0 0x7f2e741454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60786/0 (socket says 172.21.15.160:60786) 2020-11-20T12:14:28.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.022+0000 7f2e72ffd700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e740bc720 0x7f2e740c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e737fe700 1 -- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e740bc720 msgr2=0x7f2e740c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e737fe700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e740bc720 0x7f2e740c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e737fe700 1 -- 172.21.15.160:0/2045639439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e740bf4b0 msgr2=0x7f2e741454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e737fe700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e740bf4b0 0x7f2e741454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e737fe700 1 -- 172.21.15.160:0/2045639439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e741623b0 con 0x7f2e74144f30 2020-11-20T12:14:28.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e737fe700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e74144f30 0x7f2e741467c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e6c00cb10 tx=0x7f2e6c007f90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e6b7fe700 1 -- 172.21.15.160:0/2045639439 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00cee0 con 0x7f2e74144f30 2020-11-20T12:14:28.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e6b7fe700 1 -- 172.21.15.160:0/2045639439 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c00a7c0 con 0x7f2e74144f30 2020-11-20T12:14:28.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e74162650 con 0x7f2e74144f30 2020-11-20T12:14:28.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e6b7fe700 1 -- 172.21.15.160:0/2045639439 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00ab60 con 0x7f2e74144f30 2020-11-20T12:14:28.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.023+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740c2640 con 0x7f2e74144f30 2020-11-20T12:14:28.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.024+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740c2890 con 0x7f2e74144f30 2020-11-20T12:14:28.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.025+0000 7f2e6b7fe700 1 -- 172.21.15.160:0/2045639439 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2e6c019030 con 0x7f2e74144f30 2020-11-20T12:14:28.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.027+0000 7f2e6b7fe700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2e50080630 0x7f2e50082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.028+0000 7f2e6b7fe700 1 -- 172.21.15.160:0/2045639439 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f2e6c0a21f0 con 0x7f2e74144f30 2020-11-20T12:14:28.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.028+0000 7f2e72ffd700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2e50080630 0x7f2e50082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.035 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.028+0000 7f2e72ffd700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2e50080630 0x7f2e50082af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2e64006fd0 tx=0x7f2e64006eb0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.036 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.032+0000 7f2e6b7fe700 1 -- 172.21.15.160:0/2045639439 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2e6c076ce0 con 0x7f2e74144f30 2020-11-20T12:14:28.222 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.219+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f2e741464e0 con 0x7f2e74144f30 2020-11-20T12:14:28.223 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.220+0000 7f2e6b7fe700 1 -- 172.21.15.160:0/2045639439 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e6c07a300 con 0x7f2e74144f30 2020-11-20T12:14:28.224 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:28.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2e50080630 msgr2=0x7f2e50082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2e50080630 0x7f2e50082af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2e64006fd0 tx=0x7f2e64006eb0).stop 2020-11-20T12:14:28.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e74144f30 msgr2=0x7f2e741467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e74144f30 0x7f2e741467c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2e6c00cb10 tx=0x7f2e6c007f90).stop 2020-11-20T12:14:28.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 shutdown_connections 2020-11-20T12:14:28.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2e50080630 0x7f2e50082af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e74144f30 0x7f2e741467c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e740bc720 0x7f2e740c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 --2- 172.21.15.160:0/2045639439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e740bf4b0 0x7f2e741454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.222+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 >> 172.21.15.160:0/2045639439 conn(0x7f2e74062ef0 msgr2=0x7f2e7414bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.223+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 shutdown_connections 2020-11-20T12:14:28.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.223+0000 7f2e73fff700 1 -- 172.21.15.160:0/2045639439 wait complete. 2020-11-20T12:14:28.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444039 for osd.9 2020-11-20T12:14:28.249 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2020-11-20T12:14:28.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.494+0000 7f332d0e4700 1 Processor -- start 2020-11-20T12:14:28.497 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.494+0000 7f332d0e4700 1 -- start start 2020-11-20T12:14:28.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.495+0000 7f332d0e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3328061870 0x7f3328061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f332d0e4700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33280661a0 con 0x7f332814e210 2020-11-20T12:14:28.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f332d0e4700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3328066440 con 0x7f3328063390 2020-11-20T12:14:28.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f332d0e4700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3328063810 con 0x7f3328061870 2020-11-20T12:14:28.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f3327fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3328061870 0x7f3328061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f331f7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f3328063390 0x7f332814db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55854/0 (socket says 172.21.15.160:55854) 2020-11-20T12:14:28.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f3327fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3328061870 0x7f3328061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51408/0 (socket says 172.21.15.160:51408) 2020-11-20T12:14:28.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f331f7fe700 1 -- 172.21.15.160:0/3415502103 learned_addr learned my addr 172.21.15.160:0/3415502103 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:28.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f3327fff700 1 -- 172.21.15.160:0/3415502103 >> v1:172.21.15.160:6789/0 conn(0x7f3328063390 legacy=0x7f332814db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f3327fff700 1 -- 172.21.15.160:0/3415502103 >> v1:172.21.15.134:6789/0 conn(0x7f332814e210 legacy=0x7f33280b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.502 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.496+0000 7f3327fff700 1 -- 172.21.15.160:0/3415502103 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280666e0 con 0x7f3328061870 2020-11-20T12:14:28.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.497+0000 7f3327fff700 1 --2- 172.21.15.160:0/3415502103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328061870 0x7f3328061c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f331800b9a0 tx=0x7f3318006df0).ready entity=mon.1 client_cookie=19d36eeea8e2fbf server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.497+0000 7f33277fe700 1 -- 172.21.15.160:0/3415502103 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318009840 con 0x7f3328061870 2020-11-20T12:14:28.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.497+0000 7f33277fe700 1 -- 172.21.15.160:0/3415502103 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33180099a0 con 0x7f3328061870 2020-11-20T12:14:28.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.497+0000 7f33277fe700 1 -- 172.21.15.160:0/3415502103 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318009d20 con 0x7f3328061870 2020-11-20T12:14:28.503 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.497+0000 7f332d0e4700 1 -- 172.21.15.160:0/3415502103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328061870 msgr2=0x7f3328061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.497+0000 7f332d0e4700 1 --2- 172.21.15.160:0/3415502103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328061870 0x7f3328061c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f331800b9a0 tx=0x7f3318006df0).stop 2020-11-20T12:14:28.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.498+0000 7f332d0e4700 1 -- 172.21.15.160:0/3415502103 shutdown_connections 2020-11-20T12:14:28.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.498+0000 7f332d0e4700 1 --2- 172.21.15.160:0/3415502103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328061870 0x7f3328061c50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.498+0000 7f332d0e4700 1 -- 172.21.15.160:0/3415502103 >> 172.21.15.160:0/3415502103 conn(0x7f33280c4010 msgr2=0x7f33280c4420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.504 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.498+0000 7f332d0e4700 1 -- 172.21.15.160:0/3415502103 shutdown_connections 2020-11-20T12:14:28.505 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.498+0000 7f332d0e4700 1 -- 172.21.15.160:0/3415502103 wait complete. 2020-11-20T12:14:28.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.499+0000 7f332d0e4700 1 Processor -- start 2020-11-20T12:14:28.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.499+0000 7f332d0e4700 1 -- start start 2020-11-20T12:14:28.507 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.500+0000 7f332d0e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3328061870 0x7f33280c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.508 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.500+0000 7f332d0e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328063390 0x7f332811a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.508 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.500+0000 7f332d0e4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f332814e210 0x7f332811a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.508 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.500+0000 7f332d0e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33281171c0 con 0x7f3328061870 2020-11-20T12:14:28.508 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.500+0000 7f332d0e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33281140b0 con 0x7f3328063390 2020-11-20T12:14:28.509 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.500+0000 7f332d0e4700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3328114350 con 0x7f332814e210 2020-11-20T12:14:28.509 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f3327fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3328061870 0x7f33280c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.509 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f331f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328063390 0x7f332811a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.509 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f332c8e3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f332814e210 0x7f332811a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.509 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f3327fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3328061870 0x7f33280c20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60800/0 (socket says 172.21.15.160:60800) 2020-11-20T12:14:28.510 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f3327fff700 1 -- 172.21.15.160:0/942907122 learned_addr learned my addr 172.21.15.160:0/942907122 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:28.510 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f331f7fe700 1 -- 172.21.15.160:0/942907122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f332814e210 msgr2=0x7f332811a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.510 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f331f7fe700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f332814e210 0x7f332811a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.510 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f331f7fe700 1 -- 172.21.15.160:0/942907122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3328061870 msgr2=0x7f33280c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.510 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f331f7fe700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3328061870 0x7f33280c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.511 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f331f7fe700 1 -- 172.21.15.160:0/942907122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33281145f0 con 0x7f3328063390 2020-11-20T12:14:28.511 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f3327fff700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3328061870 0x7f33280c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:28.511 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f332c8e3700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f332814e210 0x7f332811a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:28.511 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f331f7fe700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328063390 0x7f332811a290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f331000c710 tx=0x7f3310007b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.511 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.501+0000 7f3324ff9700 1 -- 172.21.15.160:0/942907122 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33100072e0 con 0x7f3328063390 2020-11-20T12:14:28.512 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.502+0000 7f3324ff9700 1 -- 172.21.15.160:0/942907122 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310007440 con 0x7f3328063390 2020-11-20T12:14:28.512 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.502+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3328114890 con 0x7f3328063390 2020-11-20T12:14:28.512 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.502+0000 7f3324ff9700 1 -- 172.21.15.160:0/942907122 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310005800 con 0x7f3328063390 2020-11-20T12:14:28.512 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.502+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3328160f00 con 0x7f3328063390 2020-11-20T12:14:28.512 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.503+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328065d80 con 0x7f3328063390 2020-11-20T12:14:28.513 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.504+0000 7f3324ff9700 1 -- 172.21.15.160:0/942907122 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f331001a060 con 0x7f3328063390 2020-11-20T12:14:28.513 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.505+0000 7f3324ff9700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3304080630 0x7f3304082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.514 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.505+0000 7f3324ff9700 1 -- 172.21.15.160:0/942907122 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f33100a1ed0 con 0x7f3328063390 2020-11-20T12:14:28.514 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.505+0000 7f3327fff700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3304080630 0x7f3304082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.514 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.506+0000 7f3327fff700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3304080630 0x7f3304082af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3318009fd0 tx=0x7f3318015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.514 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.509+0000 7f3324ff9700 1 -- 172.21.15.160:0/942907122 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3310076ad0 con 0x7f3328063390 2020-11-20T12:14:28.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.694+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f33280c3df0 con 0x7f3328063390 2020-11-20T12:14:28.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.695+0000 7f3324ff9700 1 -- 172.21.15.160:0/942907122 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f3310018030 con 0x7f3328063390 2020-11-20T12:14:28.699 INFO:teuthology.orchestra.run.smithi160.stdout:73014444039 2020-11-20T12:14:28.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3304080630 msgr2=0x7f3304082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3304080630 0x7f3304082af0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3318009fd0 tx=0x7f3318015000).stop 2020-11-20T12:14:28.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328063390 msgr2=0x7f332811a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328063390 0x7f332811a290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f331000c710 tx=0x7f3310007b80).stop 2020-11-20T12:14:28.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 shutdown_connections 2020-11-20T12:14:28.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3304080630 0x7f3304082af0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f332814e210 0x7f332811a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3328061870 0x7f33280c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 --2- 172.21.15.160:0/942907122 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3328063390 0x7f332811a290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 >> 172.21.15.160:0/942907122 conn(0x7f33280c4010 msgr2=0x7f33280c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 shutdown_connections 2020-11-20T12:14:28.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.697+0000 7f332d0e4700 1 -- 172.21.15.160:0/942907122 wait complete. 2020-11-20T12:14:28.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444039 for osd.10 2020-11-20T12:14:28.725 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2020-11-20T12:14:28.966 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.962+0000 7f5c05ffc700 1 Processor -- start 2020-11-20T12:14:28.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.963+0000 7f5c05ffc700 1 -- start start 2020-11-20T12:14:28.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.964+0000 7f5c05ffc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5c000bfa20 0x7f5c000bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.964+0000 7f5c05ffc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5c00065330 0x7f5c000baef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.972 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.964+0000 7f5c05ffc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5c000bb3e0 0x7f5c00150c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.972 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.964+0000 7f5c05ffc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000bb890 con 0x7f5c000bfa20 2020-11-20T12:14:28.972 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.964+0000 7f5c05ffc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c001543e0 con 0x7f5c000bb3e0 2020-11-20T12:14:28.973 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.964+0000 7f5c05ffc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c00154680 con 0x7f5c00065330 2020-11-20T12:14:28.973 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5c000bfa20 0x7f5c000bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.973 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5c000bfa20 0x7f5c000bfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60808/0 (socket says 172.21.15.160:60808) 2020-11-20T12:14:28.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 -- 172.21.15.160:0/588928493 learned_addr learned my addr 172.21.15.160:0/588928493 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:28.974 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c057fb700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.150:3300/0 conn(0x7f5c000bb3e0 0x7f5c00150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 -- 172.21.15.160:0/588928493 >> v2:172.21.15.160:3300/0 conn(0x7f5c00065330 msgr2=0x7f5c000baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5bf7fff700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.160:3300/0 conn(0x7f5c00065330 0x7f5c000baef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.160:3300/0 conn(0x7f5c00065330 0x7f5c000baef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.975 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 -- 172.21.15.160:0/588928493 >> v2:172.21.15.150:3300/0 conn(0x7f5c000bb3e0 msgr2=0x7f5c00150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.150:3300/0 conn(0x7f5c000bb3e0 0x7f5c00150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c04ffa700 1 -- 172.21.15.160:0/588928493 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00154920 con 0x7f5c000bfa20 2020-11-20T12:14:28.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.965+0000 7f5c057fb700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.150:3300/0 conn(0x7f5c000bb3e0 0x7f5c00150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:28.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.966+0000 7f5bf7fff700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.160:3300/0 conn(0x7f5c00065330 0x7f5c000baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:28.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.966+0000 7f5c04ffa700 1 --2- 172.21.15.160:0/588928493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000bfa20 0x7f5c000bfe00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5c000bad00 tx=0x7f5bfc006eb0).ready entity=mon.0 client_cookie=e987df6c089dd60 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.966+0000 7f5bf77fe700 1 -- 172.21.15.160:0/588928493 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc009960 con 0x7f5c000bfa20 2020-11-20T12:14:28.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.966+0000 7f5bf77fe700 1 -- 172.21.15.160:0/588928493 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc009ac0 con 0x7f5c000bfa20 2020-11-20T12:14:28.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.966+0000 7f5bf77fe700 1 -- 172.21.15.160:0/588928493 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc009e40 con 0x7f5c000bfa20 2020-11-20T12:14:28.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 -- 172.21.15.160:0/588928493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000bfa20 msgr2=0x7f5c000bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/588928493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000bfa20 0x7f5c000bfe00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5c000bad00 tx=0x7f5bfc006eb0).stop 2020-11-20T12:14:28.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 -- 172.21.15.160:0/588928493 shutdown_connections 2020-11-20T12:14:28.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.150:3300/0 conn(0x7f5c000bb3e0 0x7f5c00150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/588928493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000bfa20 0x7f5c000bfe00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/588928493 >> v2:172.21.15.160:3300/0 conn(0x7f5c00065330 0x7f5c000baef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 -- 172.21.15.160:0/588928493 >> 172.21.15.160:0/588928493 conn(0x7f5c00062ef0 msgr2=0x7f5c00063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 -- 172.21.15.160:0/588928493 shutdown_connections 2020-11-20T12:14:28.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.967+0000 7f5c05ffc700 1 -- 172.21.15.160:0/588928493 wait complete. 2020-11-20T12:14:28.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.969+0000 7f5c05ffc700 1 Processor -- start 2020-11-20T12:14:28.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.969+0000 7f5c05ffc700 1 -- start start 2020-11-20T12:14:28.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.970+0000 7f5c05ffc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c00065330 0x7f5c0014d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.970+0000 7f5c05ffc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c000bb3e0 0x7f5c001607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.970+0000 7f5c05ffc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c000bfa20 0x7f5c00148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.970+0000 7f5c05ffc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000bd7e0 con 0x7f5c00065330 2020-11-20T12:14:28.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.970+0000 7f5c05ffc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0014dda0 con 0x7f5c000bb3e0 2020-11-20T12:14:28.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.970+0000 7f5c05ffc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0014fbf0 con 0x7f5c000bfa20 2020-11-20T12:14:28.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5c057fb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c000bfa20 0x7f5c00148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c000bb3e0 0x7f5c001607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5c04ffa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c00065330 0x7f5c0014d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c000bb3e0 0x7f5c001607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51428/0 (socket says 172.21.15.160:51428) 2020-11-20T12:14:28.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 -- 172.21.15.160:0/1890282075 learned_addr learned my addr 172.21.15.160:0/1890282075 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:28.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 -- 172.21.15.160:0/1890282075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c000bfa20 msgr2=0x7f5c00148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c000bfa20 0x7f5c00148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 -- 172.21.15.160:0/1890282075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c00065330 msgr2=0x7f5c0014d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c00065330 0x7f5c0014d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 -- 172.21.15.160:0/1890282075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00160cc0 con 0x7f5c000bb3e0 2020-11-20T12:14:28.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5c04ffa700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c00065330 0x7f5c0014d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:28.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.971+0000 7f5bf7fff700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c000bb3e0 0x7f5c001607d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5bf000cb50 tx=0x7f5bf0008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.992 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.972+0000 7f5bf4ff9700 1 -- 172.21.15.160:0/1890282075 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0007710 con 0x7f5c000bb3e0 2020-11-20T12:14:28.992 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.972+0000 7f5bf4ff9700 1 -- 172.21.15.160:0/1890282075 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0007870 con 0x7f5c000bb3e0 2020-11-20T12:14:28.992 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.972+0000 7f5bf4ff9700 1 -- 172.21.15.160:0/1890282075 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0007bf0 con 0x7f5c000bb3e0 2020-11-20T12:14:28.993 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.972+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c00157a20 con 0x7f5c000bb3e0 2020-11-20T12:14:28.993 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.972+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c001500f0 con 0x7f5c000bb3e0 2020-11-20T12:14:28.993 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.973+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c00044f60 con 0x7f5c000bb3e0 2020-11-20T12:14:28.994 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.974+0000 7f5bf4ff9700 1 -- 172.21.15.160:0/1890282075 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5bf001b460 con 0x7f5c000bb3e0 2020-11-20T12:14:28.994 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.975+0000 7f5bf4ff9700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5bd8080630 0x7f5bd8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.994 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.975+0000 7f5bf4ff9700 1 -- 172.21.15.160:0/1890282075 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f5bf00a29d0 con 0x7f5c000bb3e0 2020-11-20T12:14:28.995 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.975+0000 7f5c04ffa700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5bd8080630 0x7f5bd8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.995 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.976+0000 7f5c04ffa700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5bd8080630 0x7f5bd8082af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5c000bad00 tx=0x7f5bfc015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.996 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:28.979+0000 7f5bf4ff9700 1 -- 172.21.15.160:0/1890282075 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5bf0077570 con 0x7f5c000bb3e0 2020-11-20T12:14:29.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.163+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f5c00155d00 con 0x7f5c000bb3e0 2020-11-20T12:14:29.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.163+0000 7f5bf4ff9700 1 -- 172.21.15.160:0/1890282075 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f5bf007ab90 con 0x7f5c000bb3e0 2020-11-20T12:14:29.167 INFO:teuthology.orchestra.run.smithi160.stdout:73014444040 2020-11-20T12:14:29.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5bd8080630 msgr2=0x7f5bd8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5bd8080630 0x7f5bd8082af0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f5c000bad00 tx=0x7f5bfc015000).stop 2020-11-20T12:14:29.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c000bb3e0 msgr2=0x7f5c001607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c000bb3e0 0x7f5c001607d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5bf000cb50 tx=0x7f5bf0008040).stop 2020-11-20T12:14:29.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 shutdown_connections 2020-11-20T12:14:29.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5bd8080630 0x7f5bd8082af0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c000bfa20 0x7f5c00148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c00065330 0x7f5c0014d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 --2- 172.21.15.160:0/1890282075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c000bb3e0 0x7f5c001607d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.165+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 >> 172.21.15.160:0/1890282075 conn(0x7f5c00062ef0 msgr2=0x7f5c00153050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:29.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.166+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 shutdown_connections 2020-11-20T12:14:29.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.166+0000 7f5c05ffc700 1 -- 172.21.15.160:0/1890282075 wait complete. 2020-11-20T12:14:29.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444040 for osd.11 2020-11-20T12:14:29.193 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T12:14:29.194 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:14:29.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.434+0000 7f5ffa650700 1 Processor -- start 2020-11-20T12:14:29.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.435+0000 7f5ffa650700 1 -- start start 2020-11-20T12:14:29.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.436+0000 7f5ffa650700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff4155b30 con 0x7f5ff40bbfb0 2020-11-20T12:14:29.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.436+0000 7f5ffa650700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff4155dd0 con 0x7f5ff40bfb70 2020-11-20T12:14:29.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.436+0000 7f5ffa650700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff4156070 con 0x7f5ff40bff50 2020-11-20T12:14:29.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5ff8e4d700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5ff40bff50 0x7f5ff4155270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55882/0 (socket says 172.21.15.160:55882) 2020-11-20T12:14:29.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5ff8e4d700 1 -- 172.21.15.160:0/1546655028 learned_addr learned my addr 172.21.15.160:0/1546655028 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:29.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5ff964e700 1 --1- 172.21.15.160:0/1546655028 >> v1:172.21.15.150:6789/0 conn(0x7f5ff40bfb70 0x7f5ff40657e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47144/0 (socket says 172.21.15.160:47144) 2020-11-20T12:14:29.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590269765 0 0) 0x7f5ff4155b30 con 0x7f5ff40bbfb0 2020-11-20T12:14:29.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fdc003240 con 0x7f5ff40bbfb0 2020-11-20T12:14:29.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701012089 0 0) 0x7f5ff4156070 con 0x7f5ff40bff50 2020-11-20T12:14:29.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ff4155b30 con 0x7f5ff40bff50 2020-11-20T12:14:29.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.437+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2169669167 0 0) 0x7f5fdc003240 con 0x7f5ff40bbfb0 2020-11-20T12:14:29.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 >> v1:172.21.15.160:6789/0 conn(0x7f5ff40bff50 legacy=0x7f5ff4155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 >> v1:172.21.15.150:6789/0 conn(0x7f5ff40bfb70 legacy=0x7f5ff40657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff4064e00 con 0x7f5ff40bbfb0 2020-11-20T12:14:29.452 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f5fec001860 con 0x7f5ff40bbfb0 2020-11-20T12:14:29.452 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 >> v1:172.21.15.134:6789/0 conn(0x7f5ff40bbfb0 legacy=0x7f5ff40619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.452 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fdc004950 0x7f5fdc004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.453 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fdc003480 0x7f5fdc003900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.453 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5fdc00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.453 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc00bc20 con 0x7f5fdc003df0 2020-11-20T12:14:29.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc00bd60 con 0x7f5fdc004950 2020-11-20T12:14:29.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc00bea0 con 0x7f5fdc003480 2020-11-20T12:14:29.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5ff9e4f700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5fdc00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.438+0000 7f5ff964e700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fdc004950 0x7f5fdc004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff8e4d700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fdc003480 0x7f5fdc003900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff9e4f700 1 -- 172.21.15.160:0/1546655028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fdc003480 msgr2=0x7f5fdc003900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:29.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff9e4f700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fdc003480 0x7f5fdc003900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff9e4f700 1 -- 172.21.15.160:0/1546655028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fdc004950 msgr2=0x7f5fdc004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:29.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff9e4f700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fdc004950 0x7f5fdc004d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff9e4f700 1 -- 172.21.15.160:0/1546655028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc003240 con 0x7f5fdc003df0 2020-11-20T12:14:29.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff964e700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fdc004950 0x7f5fdc004d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:29.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff8e4d700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fdc003480 0x7f5fdc003900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:29.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff9e4f700 1 -- 172.21.15.160:0/1546655028 reap_dead start 2020-11-20T12:14:29.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5ff9e4f700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5fdc00b730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f5fec00c500 tx=0x7f5ff4155f60).ready entity=mon.0 client_cookie=eb1b958613808e08 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00e490 con 0x7f5fdc003df0 2020-11-20T12:14:29.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec00e5f0 con 0x7f5fdc003df0 2020-11-20T12:14:29.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.439+0000 7f5fe3fff700 1 -- 172.21.15.160:0/1546655028 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00e9b0 con 0x7f5fdc003df0 2020-11-20T12:14:29.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.440+0000 7f5ffa650700 1 -- 172.21.15.160:0/1546655028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 msgr2=0x7f5fdc00b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.440+0000 7f5ffa650700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5fdc00b730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f5fec00c500 tx=0x7f5ff4155f60).stop 2020-11-20T12:14:29.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.440+0000 7f5ffa650700 1 -- 172.21.15.160:0/1546655028 shutdown_connections 2020-11-20T12:14:29.460 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.440+0000 7f5ffa650700 1 --2- 172.21.15.160:0/1546655028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5fdc00b730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.460 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.440+0000 7f5ffa650700 1 -- 172.21.15.160:0/1546655028 >> 172.21.15.160:0/1546655028 conn(0x7f5ff4062ef0 msgr2=0x7f5ff4063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:29.460 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.440+0000 7f5ffa650700 1 -- 172.21.15.160:0/1546655028 shutdown_connections 2020-11-20T12:14:29.461 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.440+0000 7f5ffa650700 1 -- 172.21.15.160:0/1546655028 wait complete. 2020-11-20T12:14:29.461 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.442+0000 7f5ffa650700 1 Processor -- start 2020-11-20T12:14:29.461 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.442+0000 7f5ffa650700 1 -- start start 2020-11-20T12:14:29.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ffa650700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5ff4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ffa650700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff415b590 0x7f5ff4156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ffa650700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ff4164380 0x7f5ff40bca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ffa650700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4158880 con 0x7f5fdc003df0 2020-11-20T12:14:29.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ffa650700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff4158340 con 0x7f5ff415b590 2020-11-20T12:14:29.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ffa650700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff41585e0 con 0x7f5ff4164380 2020-11-20T12:14:29.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff964e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5ff4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.464 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff9e4f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ff4164380 0x7f5ff40bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.464 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff964e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5ff4158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60834/0 (socket says 172.21.15.160:60834) 2020-11-20T12:14:29.464 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff964e700 1 -- 172.21.15.160:0/526772369 learned_addr learned my addr 172.21.15.160:0/526772369 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:29.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff8e4d700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff415b590 0x7f5ff4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff9e4f700 1 -- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff415b590 msgr2=0x7f5ff4156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff9e4f700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff415b590 0x7f5ff4156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff9e4f700 1 -- 172.21.15.160:0/526772369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 msgr2=0x7f5ff4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff9e4f700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5ff4158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.443+0000 7f5ff9e4f700 1 -- 172.21.15.160:0/526772369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff415ae50 con 0x7f5ff4164380 2020-11-20T12:14:29.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.444+0000 7f5ff8e4d700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff415b590 0x7f5ff4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:29.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.444+0000 7f5ff9e4f700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ff4164380 0x7f5ff40bca10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5ff4067670 tx=0x7f5fec017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.444+0000 7f5fe17fa700 1 -- 172.21.15.160:0/526772369 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00eea0 con 0x7f5ff4164380 2020-11-20T12:14:29.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.444+0000 7f5fe17fa700 1 -- 172.21.15.160:0/526772369 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec00e280 con 0x7f5ff4164380 2020-11-20T12:14:29.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.444+0000 7f5fe17fa700 1 -- 172.21.15.160:0/526772369 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec00e3f0 con 0x7f5ff4164380 2020-11-20T12:14:29.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.444+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff415b0f0 con 0x7f5ff4164380 2020-11-20T12:14:29.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.444+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff4156a70 con 0x7f5ff4164380 2020-11-20T12:14:29.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.445+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff40c2d20 con 0x7f5ff4164380 2020-11-20T12:14:29.470 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.447+0000 7f5fe17fa700 1 -- 172.21.15.160:0/526772369 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5fec010070 con 0x7f5ff4164380 2020-11-20T12:14:29.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.448+0000 7f5fe17fa700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5fcc080660 0x7f5fcc082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.448+0000 7f5fe17fa700 1 -- 172.21.15.160:0/526772369 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f5fec0a3350 con 0x7f5ff4164380 2020-11-20T12:14:29.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.449+0000 7f5ff964e700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5fcc080660 0x7f5fcc082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.449+0000 7f5ff964e700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5fcc080660 0x7f5fcc082b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5ff0004700 tx=0x7f5ff0009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.472 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.452+0000 7f5fe17fa700 1 -- 172.21.15.160:0/526772369 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5fec077f50 con 0x7f5ff4164380 2020-11-20T12:14:29.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.635+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ff4044f60 con 0x7f5fcc080660 2020-11-20T12:14:29.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.640+0000 7f5fe17fa700 1 -- 172.21.15.160:0/526772369 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+99603 (secure 0 0 0) 0x7f5ff4044f60 con 0x7f5fcc080660 2020-11-20T12:14:29.645 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:29.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5fcc080660 msgr2=0x7f5fcc082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5fcc080660 0x7f5fcc082b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f5ff0004700 tx=0x7f5ff0009040).stop 2020-11-20T12:14:29.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ff4164380 msgr2=0x7f5ff40bca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ff4164380 0x7f5ff40bca10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f5ff4067670 tx=0x7f5fec017000).stop 2020-11-20T12:14:29.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 shutdown_connections 2020-11-20T12:14:29.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5fcc080660 0x7f5fcc082b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ff4164380 0x7f5ff40bca10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fdc003df0 0x7f5ff4158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 --2- 172.21.15.160:0/526772369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5ff415b590 0x7f5ff4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 >> 172.21.15.160:0/526772369 conn(0x7f5ff4062ef0 msgr2=0x7f5ff40632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:29.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 shutdown_connections 2020-11-20T12:14:29.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.644+0000 7f5ffa650700 1 -- 172.21.15.160:0/526772369 wait complete. 2020-11-20T12:14:29.651 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2020-11-20T12:14:29.671 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2020-11-20T12:14:28.090479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124392560,"kb_used":9550576,"kb_used_data":1114841984,"kb_used_omap":732,"kb_used_meta":0,"kb_avail":1114841984,"statfs":{"total":1151377981440,"available":1141598191616,"internally_reserved":0,"allocated":1141598191616,"data_stored":1141598191616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":749631,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002987"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.902787+0000","last_change":"2020-11-20T12:14:10.897094+0000","last_active":"2020-11-20T12:14:10.902787+0000","last_peered":"2020-11-20T12:14:10.902787+0000","last_clean":"2020-11-20T12:14:10.902787+0000","last_became_active":"2020-11-20T12:14:10.894103+0000","last_became_peered":"2020-11-20T12:14:10.894103+0000","last_unstale":"2020-11-20T12:14:10.902787+0000","last_undegraded":"2020-11-20T12:14:10.902787+0000","last_fullsized":"2020-11-20T12:14:10.902787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.881088+0000","last_change":"2020-11-20T12:14:06.159953+0000","last_active":"2020-11-20T12:14:10.881088+0000","last_peered":"2020-11-20T12:14:10.881088+0000","last_clean":"2020-11-20T12:14:10.881088+0000","last_became_active":"2020-11-20T12:14:06.159519+0000","last_became_peered":"2020-11-20T12:14:06.159519+0000","last_unstale":"2020-11-20T12:14:10.881088+0000","last_undegraded":"2020-11-20T12:14:10.881088+0000","last_fullsized":"2020-11-20T12:14:10.881088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.895549+0000","last_change":"2020-11-20T12:14:10.335478+0000","last_active":"2020-11-20T12:14:10.895549+0000","last_peered":"2020-11-20T12:14:10.895549+0000","last_clean":"2020-11-20T12:14:10.895549+0000","last_became_active":"2020-11-20T12:14:10.335057+0000","last_became_peered":"2020-11-20T12:14:10.335057+0000","last_unstale":"2020-11-20T12:14:10.895549+0000","last_undegraded":"2020-11-20T12:14:10.895549+0000","last_fullsized":"2020-11-20T12:14:10.895549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.896241+0000","last_change":"2020-11-20T12:14:10.896061+0000","last_active":"2020-11-20T12:14:10.896241+0000","last_peered":"2020-11-20T12:14:10.896241+0000","last_clean":"2020-11-20T12:14:10.896241+0000","last_became_active":"2020-11-20T12:14:10.895690+0000","last_became_peered":"2020-11-20T12:14:10.895690+0000","last_unstale":"2020-11-20T12:14:10.896241+0000","last_undegraded":"2020-11-20T12:14:10.896241+0000","last_fullsized":"2020-11-20T12:14:10.896241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.883428+0000","last_change":"2020-11-20T12:14:07.008579+0000","last_active":"2020-11-20T12:14:10.883428+0000","last_peered":"2020-11-20T12:14:10.883428+0000","last_clean":"2020-11-20T12:14:10.883428+0000","last_became_active":"2020-11-20T12:14:07.008291+0000","last_became_peered":"2020-11-20T12:14:07.008291+0000","last_unstale":"2020-11-20T12:14:10.883428+0000","last_undegraded":"2020-11-20T12:14:10.883428+0000","last_fullsized":"2020-11-20T12:14:10.883428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.895401+0000","last_change":"2020-11-20T12:14:10.534558+0000","last_active":"2020-11-20T12:14:10.895401+0000","last_peered":"2020-11-20T12:14:10.895401+0000","last_clean":"2020-11-20T12:14:10.895401+0000","last_became_active":"2020-11-20T12:14:10.534094+0000","last_became_peered":"2020-11-20T12:14:10.534094+0000","last_unstale":"2020-11-20T12:14:10.895401+0000","last_undegraded":"2020-11-20T12:14:10.895401+0000","last_fullsized":"2020-11-20T12:14:10.895401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.899402+0000","last_change":"2020-11-20T12:14:10.899194+0000","last_active":"2020-11-20T12:14:10.899402+0000","last_peered":"2020-11-20T12:14:10.899402+0000","last_clean":"2020-11-20T12:14:10.899402+0000","last_became_active":"2020-11-20T12:14:10.898829+0000","last_became_peered":"2020-11-20T12:14:10.898829+0000","last_unstale":"2020-11-20T12:14:10.899402+0000","last_undegraded":"2020-11-20T12:14:10.899402+0000","last_fullsized":"2020-11-20T12:14:10.899402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.894017+0000","last_change":"2020-11-20T12:14:07.008594+0000","last_active":"2020-11-20T12:14:10.894017+0000","last_peered":"2020-11-20T12:14:10.894017+0000","last_clean":"2020-11-20T12:14:10.894017+0000","last_became_active":"2020-11-20T12:14:07.008127+0000","last_became_peered":"2020-11-20T12:14:07.008127+0000","last_unstale":"2020-11-20T12:14:10.894017+0000","last_undegraded":"2020-11-20T12:14:10.894017+0000","last_fullsized":"2020-11-20T12:14:10.894017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.901075+0000","last_change":"2020-11-20T12:14:10.341124+0000","last_active":"2020-11-20T12:14:10.901075+0000","last_peered":"2020-11-20T12:14:10.901075+0000","last_clean":"2020-11-20T12:14:10.901075+0000","last_became_active":"2020-11-20T12:14:10.340407+0000","last_became_peered":"2020-11-20T12:14:10.340407+0000","last_unstale":"2020-11-20T12:14:10.901075+0000","last_undegraded":"2020-11-20T12:14:10.901075+0000","last_fullsized":"2020-11-20T12:14:10.901075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.895870+0000","last_change":"2020-11-20T12:14:10.894433+0000","last_active":"2020-11-20T12:14:10.895870+0000","last_peered":"2020-11-20T12:14:10.895870+0000","last_clean":"2020-11-20T12:14:10.895870+0000","last_became_active":"2020-11-20T12:14:10.894032+0000","last_became_peered":"2020-11-20T12:14:10.894032+0000","last_unstale":"2020-11-20T12:14:10.895870+0000","last_undegraded":"2020-11-20T12:14:10.895870+0000","last_fullsized":"2020-11-20T12:14:10.895870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.889703+0000","last_change":"2020-11-20T12:14:06.159050+0000","last_active":"2020-11-20T12:14:10.889703+0000","last_peered":"2020-11-20T12:14:10.889703+0000","last_clean":"2020-11-20T12:14:10.889703+0000","last_became_active":"2020-11-20T12:14:06.158623+0000","last_became_peered":"2020-11-20T12:14:06.158623+0000","last_unstale":"2020-11-20T12:14:10.889703+0000","last_undegraded":"2020-11-20T12:14:10.889703+0000","last_fullsized":"2020-11-20T12:14:10.889703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891446+0000","last_change":"2020-11-20T12:13:58.998090+0000","last_active":"2020-11-20T12:14:10.891446+0000","last_peered":"2020-11-20T12:14:10.891446+0000","last_clean":"2020-11-20T12:14:10.891446+0000","last_became_active":"2020-11-20T12:13:58.997799+0000","last_became_peered":"2020-11-20T12:13:58.997799+0000","last_unstale":"2020-11-20T12:14:10.891446+0000","last_undegraded":"2020-11-20T12:14:10.891446+0000","last_fullsized":"2020-11-20T12:14:10.891446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_clean_scrub_stamp":"2020-11-20T12:13:54.281756+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.893970+0000","last_change":"2020-11-20T12:14:10.537982+0000","last_active":"2020-11-20T12:14:10.893970+0000","last_peered":"2020-11-20T12:14:10.893970+0000","last_clean":"2020-11-20T12:14:10.893970+0000","last_became_active":"2020-11-20T12:14:10.537671+0000","last_became_peered":"2020-11-20T12:14:10.537671+0000","last_unstale":"2020-11-20T12:14:10.893970+0000","last_undegraded":"2020-11-20T12:14:10.893970+0000","last_fullsized":"2020-11-20T12:14:10.893970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.900422+0000","last_change":"2020-11-20T12:14:10.895302+0000","last_active":"2020-11-20T12:14:10.900422+0000","last_peered":"2020-11-20T12:14:10.900422+0000","last_clean":"2020-11-20T12:14:10.900422+0000","last_became_active":"2020-11-20T12:14:10.894932+0000","last_became_peered":"2020-11-20T12:14:10.894932+0000","last_unstale":"2020-11-20T12:14:10.900422+0000","last_undegraded":"2020-11-20T12:14:10.900422+0000","last_fullsized":"2020-11-20T12:14:10.900422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891316+0000","last_change":"2020-11-20T12:14:06.162793+0000","last_active":"2020-11-20T12:14:10.891316+0000","last_peered":"2020-11-20T12:14:10.891316+0000","last_clean":"2020-11-20T12:14:10.891316+0000","last_became_active":"2020-11-20T12:14:06.162506+0000","last_became_peered":"2020-11-20T12:14:06.162506+0000","last_unstale":"2020-11-20T12:14:10.891316+0000","last_undegraded":"2020-11-20T12:14:10.891316+0000","last_fullsized":"2020-11-20T12:14:10.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.888428+0000","last_change":"2020-11-20T12:14:10.336410+0000","last_active":"2020-11-20T12:14:10.888428+0000","last_peered":"2020-11-20T12:14:10.888428+0000","last_clean":"2020-11-20T12:14:10.888428+0000","last_became_active":"2020-11-20T12:14:10.336077+0000","last_became_peered":"2020-11-20T12:14:10.336077+0000","last_unstale":"2020-11-20T12:14:10.888428+0000","last_undegraded":"2020-11-20T12:14:10.888428+0000","last_fullsized":"2020-11-20T12:14:10.888428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.896969+0000","last_change":"2020-11-20T12:14:10.896686+0000","last_active":"2020-11-20T12:14:10.896969+0000","last_peered":"2020-11-20T12:14:10.896969+0000","last_clean":"2020-11-20T12:14:10.896969+0000","last_became_active":"2020-11-20T12:14:10.896333+0000","last_became_peered":"2020-11-20T12:14:10.896333+0000","last_unstale":"2020-11-20T12:14:10.896969+0000","last_undegraded":"2020-11-20T12:14:10.896969+0000","last_fullsized":"2020-11-20T12:14:10.896969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.885785+0000","last_change":"2020-11-20T12:14:06.163774+0000","last_active":"2020-11-20T12:14:10.885785+0000","last_peered":"2020-11-20T12:14:10.885785+0000","last_clean":"2020-11-20T12:14:10.885785+0000","last_became_active":"2020-11-20T12:14:06.162783+0000","last_became_peered":"2020-11-20T12:14:06.162783+0000","last_unstale":"2020-11-20T12:14:10.885785+0000","last_undegraded":"2020-11-20T12:14:10.885785+0000","last_fullsized":"2020-11-20T12:14:10.885785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.903861+0000","last_change":"2020-11-20T12:14:10.339850+0000","last_active":"2020-11-20T12:14:10.903861+0000","last_peered":"2020-11-20T12:14:10.903861+0000","last_clean":"2020-11-20T12:14:10.903861+0000","last_became_active":"2020-11-20T12:14:10.339332+0000","last_became_peered":"2020-11-20T12:14:10.339332+0000","last_unstale":"2020-11-20T12:14:10.903861+0000","last_undegraded":"2020-11-20T12:14:10.903861+0000","last_fullsized":"2020-11-20T12:14:10.903861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.894086+0000","last_change":"2020-11-20T12:14:10.892096+0000","last_active":"2020-11-20T12:14:10.894086+0000","last_peered":"2020-11-20T12:14:10.894086+0000","last_clean":"2020-11-20T12:14:10.894086+0000","last_became_active":"2020-11-20T12:14:10.891647+0000","last_became_peered":"2020-11-20T12:14:10.891647+0000","last_unstale":"2020-11-20T12:14:10.894086+0000","last_undegraded":"2020-11-20T12:14:10.894086+0000","last_fullsized":"2020-11-20T12:14:10.894086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'6","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.899174+0000","last_change":"2020-11-20T12:14:10.339704+0000","last_active":"2020-11-20T12:14:10.899174+0000","last_peered":"2020-11-20T12:14:10.899174+0000","last_clean":"2020-11-20T12:14:10.899174+0000","last_became_active":"2020-11-20T12:14:10.339274+0000","last_became_peered":"2020-11-20T12:14:10.339274+0000","last_unstale":"2020-11-20T12:14:10.899174+0000","last_undegraded":"2020-11-20T12:14:10.899174+0000","last_fullsized":"2020-11-20T12:14:10.899174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.881121+0000","last_change":"2020-11-20T12:14:06.894405+0000","last_active":"2020-11-20T12:14:10.881121+0000","last_peered":"2020-11-20T12:14:10.881121+0000","last_clean":"2020-11-20T12:14:10.881121+0000","last_became_active":"2020-11-20T12:14:06.894112+0000","last_became_peered":"2020-11-20T12:14:06.894112+0000","last_unstale":"2020-11-20T12:14:10.881121+0000","last_undegraded":"2020-11-20T12:14:10.881121+0000","last_fullsized":"2020-11-20T12:14:10.881121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:11.294441+0000","last_change":"2020-11-20T12:14:11.293900+0000","last_active":"2020-11-20T12:14:11.294441+0000","last_peered":"2020-11-20T12:14:11.294441+0000","last_clean":"2020-11-20T12:14:11.294441+0000","last_became_active":"2020-11-20T12:14:11.293129+0000","last_became_peered":"2020-11-20T12:14:11.293129+0000","last_unstale":"2020-11-20T12:14:11.294441+0000","last_undegraded":"2020-11-20T12:14:11.294441+0000","last_fullsized":"2020-11-20T12:14:11.294441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.892839+0000","last_change":"2020-11-20T12:14:06.894741+0000","last_active":"2020-11-20T12:14:10.892839+0000","last_peered":"2020-11-20T12:14:10.892839+0000","last_clean":"2020-11-20T12:14:10.892839+0000","last_became_active":"2020-11-20T12:14:06.894407+0000","last_became_peered":"2020-11-20T12:14:06.894407+0000","last_unstale":"2020-11-20T12:14:10.892839+0000","last_undegraded":"2020-11-20T12:14:10.892839+0000","last_fullsized":"2020-11-20T12:14:10.892839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:14:12.822983+0000","last_change":"2020-11-20T12:14:10.532926+0000","last_active":"2020-11-20T12:14:12.822983+0000","last_peered":"2020-11-20T12:14:12.822983+0000","last_clean":"2020-11-20T12:14:12.822983+0000","last_became_active":"2020-11-20T12:14:10.532589+0000","last_became_peered":"2020-11-20T12:14:10.532589+0000","last_unstale":"2020-11-20T12:14:12.822983+0000","last_undegraded":"2020-11-20T12:14:12.822983+0000","last_fullsized":"2020-11-20T12:14:12.822983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795880,"kb_used_data":92903500,"kb_used_omap":59,"kb_used_meta":0,"kb_avail":92903500,"statfs":{"total":95948165120,"available":95133184000,"internally_reserved":0,"allocated":95133184000,"data_stored":95133184000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61078,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8440000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.982}]}]},{"osd":10,"up_from":17,"seq":73014444039,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795888,"kb_used_data":92903492,"kb_used_omap":66,"kb_used_meta":0,"kb_avail":92903492,"statfs":{"total":95948165120,"available":95133175808,"internally_reserved":0,"allocated":95133175808,"data_stored":95133175808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68369,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6379999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1309999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7370000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":44,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45657,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4910000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.411}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1669999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]}]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795880,"kb_used_data":92903500,"kb_used_omap":81,"kb_used_meta":0,"kb_avail":92903500,"statfs":{"total":95948165120,"available":95133184000,"internally_reserved":0,"allocated":95133184000,"data_stored":95133184000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83505,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9119999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7070000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":54,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55436,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7210000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795884,"kb_used_data":92903496,"kb_used_omap":68,"kb_used_meta":0,"kb_avail":92903496,"statfs":{"total":95948165120,"available":95133179904,"internally_reserved":0,"allocated":95133179904,"data_stored":95133179904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69737,"internal_metadata":0},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6389999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.383}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8250000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4240000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5579999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6360000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9829999999999997}]}]},{"osd":1,"up_from":17,"seq":73014444040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":48,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49614,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8839999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":70,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72527,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3450000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5659999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.637}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1139999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2519999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8069999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8959999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":34,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34886,"internal_metadata":0},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]}]},{"osd":3,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795888,"kb_used_data":92903492,"kb_used_omap":69,"kb_used_meta":0,"kb_avail":92903492,"statfs":{"total":95948165120,"available":95133175808,"internally_reserved":0,"allocated":95133175808,"data_stored":95133175808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70665,"internal_metadata":0},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8170000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7290000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1779999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.468}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.577}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8470000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6109999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444041,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795892,"kb_used_data":92903488,"kb_used_omap":75,"kb_used_meta":0,"kb_avail":92903488,"statfs":{"total":95948165120,"available":95133171712,"internally_reserved":0,"allocated":95133171712,"data_stored":95133171712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":77164,"internal_metadata":0},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7569999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444040,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795884,"kb_used_data":92903496,"kb_used_omap":59,"kb_used_meta":0,"kb_avail":92903496,"statfs":{"total":95948165120,"available":95133179904,"internally_reserved":0,"allocated":95133179904,"data_stored":95133179904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60993,"internal_metadata":0},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]}]}]}} 2020-11-20T12:14:29.675 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:14:29.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.915+0000 7f301ce4f700 1 Processor -- start 2020-11-20T12:14:29.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.916+0000 7f301ce4f700 1 -- start start 2020-11-20T12:14:29.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.917+0000 7f301ce4f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3018061870 0x7f3018061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.917+0000 7f301ce4f700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f3018063a10 0x7f30180bd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.917+0000 7f301ce4f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30180bdda0 0x7f301814f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.917+0000 7f301ce4f700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30180bf640 con 0x7f3018063a10 2020-11-20T12:14:29.922 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.917+0000 7f301ce4f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3018064e00 con 0x7f30180bdda0 2020-11-20T12:14:29.922 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.917+0000 7f301ce4f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30180bca40 con 0x7f3018061870 2020-11-20T12:14:29.922 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30180bdda0 0x7f301814f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.924 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f30180bdda0 0x7f301814f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51458/0 (socket says 172.21.15.160:51458) 2020-11-20T12:14:29.924 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 -- 172.21.15.160:0/2733855803 learned_addr learned my addr 172.21.15.160:0/2733855803 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:29.924 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f30177fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3018061870 0x7f3018061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f300effd700 1 --2- 172.21.15.160:0/2733855803 >> v2:172.21.15.134:3300/0 conn(0x7f3018063a10 0x7f30180bd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 -- 172.21.15.160:0/2733855803 >> v2:172.21.15.160:3300/0 conn(0x7f3018061870 msgr2=0x7f3018061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:29.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 --2- 172.21.15.160:0/2733855803 >> v2:172.21.15.160:3300/0 conn(0x7f3018061870 0x7f3018061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 -- 172.21.15.160:0/2733855803 >> v2:172.21.15.134:3300/0 conn(0x7f3018063a10 msgr2=0x7f30180bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:29.925 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 --2- 172.21.15.160:0/2733855803 >> v2:172.21.15.134:3300/0 conn(0x7f3018063a10 0x7f30180bd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.918+0000 7f3017fff700 1 -- 172.21.15.160:0/2733855803 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30180bcce0 con 0x7f30180bdda0 2020-11-20T12:14:29.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.919+0000 7f3017fff700 1 --2- 172.21.15.160:0/2733855803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 0x7f301814f100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3018066e40 tx=0x7f3010009290).ready entity=mon.1 client_cookie=335c98a3bae0c364 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.919+0000 7f3016ffd700 1 -- 172.21.15.160:0/2733855803 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301000bba0 con 0x7f30180bdda0 2020-11-20T12:14:29.926 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.919+0000 7f3016ffd700 1 -- 172.21.15.160:0/2733855803 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301000bd00 con 0x7f30180bdda0 2020-11-20T12:14:29.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.919+0000 7f3016ffd700 1 -- 172.21.15.160:0/2733855803 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010011610 con 0x7f30180bdda0 2020-11-20T12:14:29.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.919+0000 7f301ce4f700 1 -- 172.21.15.160:0/2733855803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 msgr2=0x7f301814f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.919+0000 7f301ce4f700 1 --2- 172.21.15.160:0/2733855803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 0x7f301814f100 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f3018066e40 tx=0x7f3010009290).stop 2020-11-20T12:14:29.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.920+0000 7f301ce4f700 1 -- 172.21.15.160:0/2733855803 shutdown_connections 2020-11-20T12:14:29.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.920+0000 7f301ce4f700 1 --2- 172.21.15.160:0/2733855803 >> v2:172.21.15.160:3300/0 conn(0x7f3018061870 0x7f3018061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.920+0000 7f301ce4f700 1 --2- 172.21.15.160:0/2733855803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 0x7f301814f100 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.920+0000 7f301ce4f700 1 --2- 172.21.15.160:0/2733855803 >> v2:172.21.15.134:3300/0 conn(0x7f3018063a10 0x7f30180bd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.920+0000 7f301ce4f700 1 -- 172.21.15.160:0/2733855803 >> 172.21.15.160:0/2733855803 conn(0x7f3018062ef0 msgr2=0x7f3018063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:29.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.920+0000 7f301ce4f700 1 -- 172.21.15.160:0/2733855803 shutdown_connections 2020-11-20T12:14:29.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.920+0000 7f301ce4f700 1 -- 172.21.15.160:0/2733855803 wait complete. 2020-11-20T12:14:29.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.922+0000 7f301ce4f700 1 Processor -- start 2020-11-20T12:14:29.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.922+0000 7f301ce4f700 1 -- start start 2020-11-20T12:14:29.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f301ce4f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3018061870 0x7f301815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f301ce4f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3018063a10 0x7f301810dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f301ce4f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 0x7f3018152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f301ce4f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301815efe0 con 0x7f3018061870 2020-11-20T12:14:29.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f301ce4f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301810e5b0 con 0x7f30180bdda0 2020-11-20T12:14:29.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f301ce4f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018161730 con 0x7f3018063a10 2020-11-20T12:14:29.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f30177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3018061870 0x7f301815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f300effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3018063a10 0x7f301810dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f30177fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3018061870 0x7f301815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60848/0 (socket says 172.21.15.160:60848) 2020-11-20T12:14:29.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f30177fe700 1 -- 172.21.15.160:0/1275090590 learned_addr learned my addr 172.21.15.160:0/1275090590 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:29.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.923+0000 7f3017fff700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 0x7f3018152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f30177fe700 1 -- 172.21.15.160:0/1275090590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3018063a10 msgr2=0x7f301810dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f30177fe700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3018063a10 0x7f301810dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f30177fe700 1 -- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 msgr2=0x7f3018152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f30177fe700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 0x7f3018152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f30177fe700 1 -- 172.21.15.160:0/1275090590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30181619d0 con 0x7f3018061870 2020-11-20T12:14:29.935 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f30177fe700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3018061870 0x7f301815eaf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f300800eba0 tx=0x7f3008006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.935 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f300ffff700 1 -- 172.21.15.160:0/1275090590 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800c8e0 con 0x7f3018061870 2020-11-20T12:14:29.935 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f300ffff700 1 -- 172.21.15.160:0/1275090590 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800ca40 con 0x7f3018061870 2020-11-20T12:14:29.935 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f300ffff700 1 -- 172.21.15.160:0/1275090590 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800cdc0 con 0x7f3018061870 2020-11-20T12:14:29.935 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3018161c70 con 0x7f3018061870 2020-11-20T12:14:29.936 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.924+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30181621b0 con 0x7f3018061870 2020-11-20T12:14:29.936 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.925+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3018044f60 con 0x7f3018061870 2020-11-20T12:14:29.936 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.927+0000 7f300ffff700 1 -- 172.21.15.160:0/1275090590 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3008012600 con 0x7f3018061870 2020-11-20T12:14:29.936 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.928+0000 7f300ffff700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2ff4080660 0x7f2ff4082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.936 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.928+0000 7f300ffff700 1 -- 172.21.15.160:0/1275090590 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f30080a2c20 con 0x7f3018061870 2020-11-20T12:14:29.937 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.928+0000 7f300effd700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2ff4080660 0x7f2ff4082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.938 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.928+0000 7f300effd700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2ff4080660 0x7f2ff4082b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3018069640 tx=0x7f3000006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.938 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:29.931+0000 7f300ffff700 1 -- 172.21.15.160:0/1275090590 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3008077820 con 0x7f3018061870 2020-11-20T12:14:30.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.112+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f301814e710 con 0x7f2ff4080660 2020-11-20T12:14:30.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.117+0000 7f300ffff700 1 -- 172.21.15.160:0/1275090590 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+99433 (secure 0 0 0) 0x7f301814e710 con 0x7f2ff4080660 2020-11-20T12:14:30.122 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:30.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2ff4080660 msgr2=0x7f2ff4082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2ff4080660 0x7f2ff4082b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3018069640 tx=0x7f3000006df0).stop 2020-11-20T12:14:30.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3018061870 msgr2=0x7f301815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3018061870 0x7f301815eaf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f300800eba0 tx=0x7f3008006df0).stop 2020-11-20T12:14:30.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 shutdown_connections 2020-11-20T12:14:30.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2ff4080660 0x7f2ff4082b20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30180bdda0 0x7f3018152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3018061870 0x7f301815eaf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 --2- 172.21.15.160:0/1275090590 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3018063a10 0x7f301810dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.120+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 >> 172.21.15.160:0/1275090590 conn(0x7f3018062ef0 msgr2=0x7f3018148dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:30.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.121+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 shutdown_connections 2020-11-20T12:14:30.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.121+0000 7f301ce4f700 1 -- 172.21.15.160:0/1275090590 wait complete. 2020-11-20T12:14:30.129 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2020-11-20T12:14:30.148 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2020-11-20T12:14:30.091042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124392560,"kb_used":9550576,"kb_used_data":1114841984,"kb_used_omap":732,"kb_used_meta":0,"kb_avail":1114841984,"statfs":{"total":1151377981440,"available":1141598191616,"internally_reserved":0,"allocated":1141598191616,"data_stored":1141598191616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":749631,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002995"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.902787+0000","last_change":"2020-11-20T12:14:10.897094+0000","last_active":"2020-11-20T12:14:10.902787+0000","last_peered":"2020-11-20T12:14:10.902787+0000","last_clean":"2020-11-20T12:14:10.902787+0000","last_became_active":"2020-11-20T12:14:10.894103+0000","last_became_peered":"2020-11-20T12:14:10.894103+0000","last_unstale":"2020-11-20T12:14:10.902787+0000","last_undegraded":"2020-11-20T12:14:10.902787+0000","last_fullsized":"2020-11-20T12:14:10.902787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.881088+0000","last_change":"2020-11-20T12:14:06.159953+0000","last_active":"2020-11-20T12:14:10.881088+0000","last_peered":"2020-11-20T12:14:10.881088+0000","last_clean":"2020-11-20T12:14:10.881088+0000","last_became_active":"2020-11-20T12:14:06.159519+0000","last_became_peered":"2020-11-20T12:14:06.159519+0000","last_unstale":"2020-11-20T12:14:10.881088+0000","last_undegraded":"2020-11-20T12:14:10.881088+0000","last_fullsized":"2020-11-20T12:14:10.881088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'6","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.895549+0000","last_change":"2020-11-20T12:14:10.335478+0000","last_active":"2020-11-20T12:14:10.895549+0000","last_peered":"2020-11-20T12:14:10.895549+0000","last_clean":"2020-11-20T12:14:10.895549+0000","last_became_active":"2020-11-20T12:14:10.335057+0000","last_became_peered":"2020-11-20T12:14:10.335057+0000","last_unstale":"2020-11-20T12:14:10.895549+0000","last_undegraded":"2020-11-20T12:14:10.895549+0000","last_fullsized":"2020-11-20T12:14:10.895549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.896241+0000","last_change":"2020-11-20T12:14:10.896061+0000","last_active":"2020-11-20T12:14:10.896241+0000","last_peered":"2020-11-20T12:14:10.896241+0000","last_clean":"2020-11-20T12:14:10.896241+0000","last_became_active":"2020-11-20T12:14:10.895690+0000","last_became_peered":"2020-11-20T12:14:10.895690+0000","last_unstale":"2020-11-20T12:14:10.896241+0000","last_undegraded":"2020-11-20T12:14:10.896241+0000","last_fullsized":"2020-11-20T12:14:10.896241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.883428+0000","last_change":"2020-11-20T12:14:07.008579+0000","last_active":"2020-11-20T12:14:10.883428+0000","last_peered":"2020-11-20T12:14:10.883428+0000","last_clean":"2020-11-20T12:14:10.883428+0000","last_became_active":"2020-11-20T12:14:07.008291+0000","last_became_peered":"2020-11-20T12:14:07.008291+0000","last_unstale":"2020-11-20T12:14:10.883428+0000","last_undegraded":"2020-11-20T12:14:10.883428+0000","last_fullsized":"2020-11-20T12:14:10.883428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'5","reported_seq":"15","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.895401+0000","last_change":"2020-11-20T12:14:10.534558+0000","last_active":"2020-11-20T12:14:10.895401+0000","last_peered":"2020-11-20T12:14:10.895401+0000","last_clean":"2020-11-20T12:14:10.895401+0000","last_became_active":"2020-11-20T12:14:10.534094+0000","last_became_peered":"2020-11-20T12:14:10.534094+0000","last_unstale":"2020-11-20T12:14:10.895401+0000","last_undegraded":"2020-11-20T12:14:10.895401+0000","last_fullsized":"2020-11-20T12:14:10.895401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.899402+0000","last_change":"2020-11-20T12:14:10.899194+0000","last_active":"2020-11-20T12:14:10.899402+0000","last_peered":"2020-11-20T12:14:10.899402+0000","last_clean":"2020-11-20T12:14:10.899402+0000","last_became_active":"2020-11-20T12:14:10.898829+0000","last_became_peered":"2020-11-20T12:14:10.898829+0000","last_unstale":"2020-11-20T12:14:10.899402+0000","last_undegraded":"2020-11-20T12:14:10.899402+0000","last_fullsized":"2020-11-20T12:14:10.899402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.894017+0000","last_change":"2020-11-20T12:14:07.008594+0000","last_active":"2020-11-20T12:14:10.894017+0000","last_peered":"2020-11-20T12:14:10.894017+0000","last_clean":"2020-11-20T12:14:10.894017+0000","last_became_active":"2020-11-20T12:14:07.008127+0000","last_became_peered":"2020-11-20T12:14:07.008127+0000","last_unstale":"2020-11-20T12:14:10.894017+0000","last_undegraded":"2020-11-20T12:14:10.894017+0000","last_fullsized":"2020-11-20T12:14:10.894017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"25'8","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.901075+0000","last_change":"2020-11-20T12:14:10.341124+0000","last_active":"2020-11-20T12:14:10.901075+0000","last_peered":"2020-11-20T12:14:10.901075+0000","last_clean":"2020-11-20T12:14:10.901075+0000","last_became_active":"2020-11-20T12:14:10.340407+0000","last_became_peered":"2020-11-20T12:14:10.340407+0000","last_unstale":"2020-11-20T12:14:10.901075+0000","last_undegraded":"2020-11-20T12:14:10.901075+0000","last_fullsized":"2020-11-20T12:14:10.901075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.895870+0000","last_change":"2020-11-20T12:14:10.894433+0000","last_active":"2020-11-20T12:14:10.895870+0000","last_peered":"2020-11-20T12:14:10.895870+0000","last_clean":"2020-11-20T12:14:10.895870+0000","last_became_active":"2020-11-20T12:14:10.894032+0000","last_became_peered":"2020-11-20T12:14:10.894032+0000","last_unstale":"2020-11-20T12:14:10.895870+0000","last_undegraded":"2020-11-20T12:14:10.895870+0000","last_fullsized":"2020-11-20T12:14:10.895870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.889703+0000","last_change":"2020-11-20T12:14:06.159050+0000","last_active":"2020-11-20T12:14:10.889703+0000","last_peered":"2020-11-20T12:14:10.889703+0000","last_clean":"2020-11-20T12:14:10.889703+0000","last_became_active":"2020-11-20T12:14:06.158623+0000","last_became_peered":"2020-11-20T12:14:06.158623+0000","last_unstale":"2020-11-20T12:14:10.889703+0000","last_undegraded":"2020-11-20T12:14:10.889703+0000","last_fullsized":"2020-11-20T12:14:10.889703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891446+0000","last_change":"2020-11-20T12:13:58.998090+0000","last_active":"2020-11-20T12:14:10.891446+0000","last_peered":"2020-11-20T12:14:10.891446+0000","last_clean":"2020-11-20T12:14:10.891446+0000","last_became_active":"2020-11-20T12:13:58.997799+0000","last_became_peered":"2020-11-20T12:13:58.997799+0000","last_unstale":"2020-11-20T12:14:10.891446+0000","last_undegraded":"2020-11-20T12:14:10.891446+0000","last_fullsized":"2020-11-20T12:14:10.891446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_clean_scrub_stamp":"2020-11-20T12:13:54.281756+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"25'1","reported_seq":"11","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.893970+0000","last_change":"2020-11-20T12:14:10.537982+0000","last_active":"2020-11-20T12:14:10.893970+0000","last_peered":"2020-11-20T12:14:10.893970+0000","last_clean":"2020-11-20T12:14:10.893970+0000","last_became_active":"2020-11-20T12:14:10.537671+0000","last_became_peered":"2020-11-20T12:14:10.537671+0000","last_unstale":"2020-11-20T12:14:10.893970+0000","last_undegraded":"2020-11-20T12:14:10.893970+0000","last_fullsized":"2020-11-20T12:14:10.893970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.900422+0000","last_change":"2020-11-20T12:14:10.895302+0000","last_active":"2020-11-20T12:14:10.900422+0000","last_peered":"2020-11-20T12:14:10.900422+0000","last_clean":"2020-11-20T12:14:10.900422+0000","last_became_active":"2020-11-20T12:14:10.894932+0000","last_became_peered":"2020-11-20T12:14:10.894932+0000","last_unstale":"2020-11-20T12:14:10.900422+0000","last_undegraded":"2020-11-20T12:14:10.900422+0000","last_fullsized":"2020-11-20T12:14:10.900422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891316+0000","last_change":"2020-11-20T12:14:06.162793+0000","last_active":"2020-11-20T12:14:10.891316+0000","last_peered":"2020-11-20T12:14:10.891316+0000","last_clean":"2020-11-20T12:14:10.891316+0000","last_became_active":"2020-11-20T12:14:06.162506+0000","last_became_peered":"2020-11-20T12:14:06.162506+0000","last_unstale":"2020-11-20T12:14:10.891316+0000","last_undegraded":"2020-11-20T12:14:10.891316+0000","last_fullsized":"2020-11-20T12:14:10.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.888428+0000","last_change":"2020-11-20T12:14:10.336410+0000","last_active":"2020-11-20T12:14:10.888428+0000","last_peered":"2020-11-20T12:14:10.888428+0000","last_clean":"2020-11-20T12:14:10.888428+0000","last_became_active":"2020-11-20T12:14:10.336077+0000","last_became_peered":"2020-11-20T12:14:10.336077+0000","last_unstale":"2020-11-20T12:14:10.888428+0000","last_undegraded":"2020-11-20T12:14:10.888428+0000","last_fullsized":"2020-11-20T12:14:10.888428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.896969+0000","last_change":"2020-11-20T12:14:10.896686+0000","last_active":"2020-11-20T12:14:10.896969+0000","last_peered":"2020-11-20T12:14:10.896969+0000","last_clean":"2020-11-20T12:14:10.896969+0000","last_became_active":"2020-11-20T12:14:10.896333+0000","last_became_peered":"2020-11-20T12:14:10.896333+0000","last_unstale":"2020-11-20T12:14:10.896969+0000","last_undegraded":"2020-11-20T12:14:10.896969+0000","last_fullsized":"2020-11-20T12:14:10.896969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.885785+0000","last_change":"2020-11-20T12:14:06.163774+0000","last_active":"2020-11-20T12:14:10.885785+0000","last_peered":"2020-11-20T12:14:10.885785+0000","last_clean":"2020-11-20T12:14:10.885785+0000","last_became_active":"2020-11-20T12:14:06.162783+0000","last_became_peered":"2020-11-20T12:14:06.162783+0000","last_unstale":"2020-11-20T12:14:10.885785+0000","last_undegraded":"2020-11-20T12:14:10.885785+0000","last_fullsized":"2020-11-20T12:14:10.885785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"25'8","reported_seq":"18","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.903861+0000","last_change":"2020-11-20T12:14:10.339850+0000","last_active":"2020-11-20T12:14:10.903861+0000","last_peered":"2020-11-20T12:14:10.903861+0000","last_clean":"2020-11-20T12:14:10.903861+0000","last_became_active":"2020-11-20T12:14:10.339332+0000","last_became_peered":"2020-11-20T12:14:10.339332+0000","last_unstale":"2020-11-20T12:14:10.903861+0000","last_undegraded":"2020-11-20T12:14:10.903861+0000","last_fullsized":"2020-11-20T12:14:10.903861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.894086+0000","last_change":"2020-11-20T12:14:10.892096+0000","last_active":"2020-11-20T12:14:10.894086+0000","last_peered":"2020-11-20T12:14:10.894086+0000","last_clean":"2020-11-20T12:14:10.894086+0000","last_became_active":"2020-11-20T12:14:10.891647+0000","last_became_peered":"2020-11-20T12:14:10.891647+0000","last_unstale":"2020-11-20T12:14:10.894086+0000","last_undegraded":"2020-11-20T12:14:10.894086+0000","last_fullsized":"2020-11-20T12:14:10.894086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'6","reported_seq":"16","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.899174+0000","last_change":"2020-11-20T12:14:10.339704+0000","last_active":"2020-11-20T12:14:10.899174+0000","last_peered":"2020-11-20T12:14:10.899174+0000","last_clean":"2020-11-20T12:14:10.899174+0000","last_became_active":"2020-11-20T12:14:10.339274+0000","last_became_peered":"2020-11-20T12:14:10.339274+0000","last_unstale":"2020-11-20T12:14:10.899174+0000","last_undegraded":"2020-11-20T12:14:10.899174+0000","last_fullsized":"2020-11-20T12:14:10.899174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.881121+0000","last_change":"2020-11-20T12:14:06.894405+0000","last_active":"2020-11-20T12:14:10.881121+0000","last_peered":"2020-11-20T12:14:10.881121+0000","last_clean":"2020-11-20T12:14:10.881121+0000","last_became_active":"2020-11-20T12:14:06.894112+0000","last_became_peered":"2020-11-20T12:14:06.894112+0000","last_unstale":"2020-11-20T12:14:10.881121+0000","last_undegraded":"2020-11-20T12:14:10.881121+0000","last_fullsized":"2020-11-20T12:14:10.881121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:11.294441+0000","last_change":"2020-11-20T12:14:11.293900+0000","last_active":"2020-11-20T12:14:11.294441+0000","last_peered":"2020-11-20T12:14:11.294441+0000","last_clean":"2020-11-20T12:14:11.294441+0000","last_became_active":"2020-11-20T12:14:11.293129+0000","last_became_peered":"2020-11-20T12:14:11.293129+0000","last_unstale":"2020-11-20T12:14:11.294441+0000","last_undegraded":"2020-11-20T12:14:11.294441+0000","last_fullsized":"2020-11-20T12:14:11.294441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.892839+0000","last_change":"2020-11-20T12:14:06.894741+0000","last_active":"2020-11-20T12:14:10.892839+0000","last_peered":"2020-11-20T12:14:10.892839+0000","last_clean":"2020-11-20T12:14:10.892839+0000","last_became_active":"2020-11-20T12:14:06.894407+0000","last_became_peered":"2020-11-20T12:14:06.894407+0000","last_unstale":"2020-11-20T12:14:10.892839+0000","last_undegraded":"2020-11-20T12:14:10.892839+0000","last_fullsized":"2020-11-20T12:14:10.892839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"26'4","reported_seq":"14","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:14:12.822983+0000","last_change":"2020-11-20T12:14:10.532926+0000","last_active":"2020-11-20T12:14:12.822983+0000","last_peered":"2020-11-20T12:14:12.822983+0000","last_clean":"2020-11-20T12:14:12.822983+0000","last_became_active":"2020-11-20T12:14:10.532589+0000","last_became_peered":"2020-11-20T12:14:10.532589+0000","last_unstale":"2020-11-20T12:14:12.822983+0000","last_undegraded":"2020-11-20T12:14:12.822983+0000","last_fullsized":"2020-11-20T12:14:12.822983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795880,"kb_used_data":92903500,"kb_used_omap":59,"kb_used_meta":0,"kb_avail":92903500,"statfs":{"total":95948165120,"available":95133184000,"internally_reserved":0,"allocated":95133184000,"data_stored":95133184000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":61078,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9139999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.837}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6970000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8720000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444040,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795888,"kb_used_data":92903492,"kb_used_omap":66,"kb_used_meta":0,"kb_avail":92903492,"statfs":{"total":95948165120,"available":95133175808,"internally_reserved":0,"allocated":95133175808,"data_stored":95133175808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":68369,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]}]},{"osd":9,"up_from":17,"seq":73014444040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":44,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45657,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.867}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4910000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.411}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1669999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3170000000000002}]}]},{"osd":8,"up_from":17,"seq":73014444042,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795880,"kb_used_data":92903500,"kb_used_omap":81,"kb_used_meta":0,"kb_avail":92903500,"statfs":{"total":95948165120,"available":95133184000,"internally_reserved":0,"allocated":95133184000,"data_stored":95133184000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":83505,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.597}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6930000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]}]},{"osd":7,"up_from":17,"seq":73014444041,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":54,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55436,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.742}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8100000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8779999999999999}]}]},{"osd":6,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795884,"kb_used_data":92903496,"kb_used_omap":68,"kb_used_meta":0,"kb_avail":92903496,"statfs":{"total":95948165120,"available":95133179904,"internally_reserved":0,"allocated":95133179904,"data_stored":95133179904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":69737,"internal_metadata":0},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6389999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.383}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8250000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4240000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5579999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6360000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.9829999999999997}]}]},{"osd":1,"up_from":17,"seq":73014444041,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":48,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49614,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.105}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.825}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.845}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.502}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]}]},{"osd":0,"up_from":17,"seq":73014444040,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":70,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":72527,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3450000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5659999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.637}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1139999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2519999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8069999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.8959999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444040,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795876,"kb_used_data":92903504,"kb_used_omap":34,"kb_used_meta":0,"kb_avail":92903504,"statfs":{"total":95948165120,"available":95133188096,"internally_reserved":0,"allocated":95133188096,"data_stored":95133188096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34886,"internal_metadata":0},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.708}]}]},{"osd":3,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795888,"kb_used_data":92903492,"kb_used_omap":69,"kb_used_meta":0,"kb_avail":92903492,"statfs":{"total":95948165120,"available":95133175808,"internally_reserved":0,"allocated":95133175808,"data_stored":95133175808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":70665,"internal_metadata":0},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8170000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.0350000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.7290000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1779999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.468}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.577}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8470000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6109999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795892,"kb_used_data":92903488,"kb_used_omap":75,"kb_used_meta":0,"kb_avail":92903488,"statfs":{"total":95948165120,"available":95133171712,"internally_reserved":0,"allocated":95133171712,"data_stored":95133171712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":77164,"internal_metadata":0},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.325}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.827}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.085}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9750000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8680000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444041,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":795884,"kb_used_data":92903496,"kb_used_omap":59,"kb_used_meta":0,"kb_avail":92903496,"statfs":{"total":95948165120,"available":95133179904,"internally_reserved":0,"allocated":95133179904,"data_stored":95133179904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60993,"internal_metadata":0},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.917}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.845}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]}]}]}} 2020-11-20T12:14:30.153 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T12:14:30.153 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T12:14:30.154 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T12:14:30.154 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-20T12:14:30.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.396+0000 7f141e3d6700 1 Processor -- start 2020-11-20T12:14:30.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.396+0000 7f141e3d6700 1 -- start start 2020-11-20T12:14:30.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.398+0000 7f141e3d6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1418061870 0x7f1418061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.398+0000 7f141e3d6700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1418150ed0 con 0x7f14180c0510 2020-11-20T12:14:30.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.398+0000 7f141e3d6700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1418151170 con 0x7f14180bb9b0 2020-11-20T12:14:30.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.398+0000 7f141e3d6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1418151410 con 0x7f1418061870 2020-11-20T12:14:30.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.398+0000 7f141cbd3700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f14180c0510 0x7f14180bb2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60642/0 (socket says 172.21.15.160:60642) 2020-11-20T12:14:30.429 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.398+0000 7f141d3d4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f1418061870 0x7f1418061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.429 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.398+0000 7f141cbd3700 1 -- 172.21.15.160:0/789624512 learned_addr learned my addr 172.21.15.160:0/789624512 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:30.429 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f1417fff700 1 -- 172.21.15.160:0/789624512 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179997221 0 0) 0x7f1418150ed0 con 0x7f14180c0510 2020-11-20T12:14:30.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f1417fff700 1 -- 172.21.15.160:0/789624512 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13fc003240 con 0x7f14180c0510 2020-11-20T12:14:30.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f141d3d4700 1 -- 172.21.15.160:0/789624512 >> v1:172.21.15.160:6789/0 conn(0x7f14180bb9b0 legacy=0x7f1418064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f141d3d4700 1 -- 172.21.15.160:0/789624512 >> v1:172.21.15.134:6789/0 conn(0x7f14180c0510 legacy=0x7f14180bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f141d3d4700 1 -- 172.21.15.160:0/789624512 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14181516b0 con 0x7f1418061870 2020-11-20T12:14:30.430 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f141d3d4700 1 --2- 172.21.15.160:0/789624512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418061c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f140c009c90 tx=0x7f140c0091d0).ready entity=mon.1 client_cookie=587846731ed2d93c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f1417fff700 1 -- 172.21.15.160:0/789624512 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00bb00 con 0x7f1418061870 2020-11-20T12:14:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f1417fff700 1 -- 172.21.15.160:0/789624512 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c00bc60 con 0x7f1418061870 2020-11-20T12:14:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.399+0000 7f1417fff700 1 -- 172.21.15.160:0/789624512 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011400 con 0x7f1418061870 2020-11-20T12:14:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.400+0000 7f141e3d6700 1 -- 172.21.15.160:0/789624512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 msgr2=0x7f1418061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.431 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.400+0000 7f141e3d6700 1 --2- 172.21.15.160:0/789624512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418061c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f140c009c90 tx=0x7f140c0091d0).stop 2020-11-20T12:14:30.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.400+0000 7f141e3d6700 1 -- 172.21.15.160:0/789624512 shutdown_connections 2020-11-20T12:14:30.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.400+0000 7f141e3d6700 1 --2- 172.21.15.160:0/789624512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418061c50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.400+0000 7f141e3d6700 1 -- 172.21.15.160:0/789624512 >> 172.21.15.160:0/789624512 conn(0x7f1418062ef0 msgr2=0x7f1418063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:30.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.400+0000 7f141e3d6700 1 -- 172.21.15.160:0/789624512 shutdown_connections 2020-11-20T12:14:30.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.400+0000 7f141e3d6700 1 -- 172.21.15.160:0/789624512 wait complete. 2020-11-20T12:14:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.402+0000 7f141e3d6700 1 Processor -- start 2020-11-20T12:14:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.402+0000 7f141e3d6700 1 -- start start 2020-11-20T12:14:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141e3d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141e3d6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14180bb9b0 0x7f1418154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141e3d6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14180c0510 0x7f1418164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141e3d6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14181538d0 con 0x7f14180bb9b0 2020-11-20T12:14:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141e3d6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141814a2f0 con 0x7f1418061870 2020-11-20T12:14:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141e3d6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418153ac0 con 0x7f14180c0510 2020-11-20T12:14:30.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141d3d4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.403+0000 7f141d3d4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51476/0 (socket says 172.21.15.160:51476) 2020-11-20T12:14:30.436 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141d3d4700 1 -- 172.21.15.160:0/2725637683 learned_addr learned my addr 172.21.15.160:0/2725637683 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:30.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141dbd5700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14180c0510 0x7f1418164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141cbd3700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14180bb9b0 0x7f1418154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141d3d4700 1 -- 172.21.15.160:0/2725637683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14180c0510 msgr2=0x7f1418164180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141d3d4700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14180c0510 0x7f1418164180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141d3d4700 1 -- 172.21.15.160:0/2725637683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14180bb9b0 msgr2=0x7f1418154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141d3d4700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14180bb9b0 0x7f1418154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141d3d4700 1 -- 172.21.15.160:0/2725637683 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418153d60 con 0x7f1418061870 2020-11-20T12:14:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f141d3d4700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418149ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f140c009210 tx=0x7f140c016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:30.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.404+0000 7f14157fa700 1 -- 172.21.15.160:0/2725637683 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c011e30 con 0x7f1418061870 2020-11-20T12:14:30.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.405+0000 7f14157fa700 1 -- 172.21.15.160:0/2725637683 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140c01c5f0 con 0x7f1418061870 2020-11-20T12:14:30.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.405+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1418154000 con 0x7f1418061870 2020-11-20T12:14:30.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.405+0000 7f14157fa700 1 -- 172.21.15.160:0/2725637683 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c01c970 con 0x7f1418061870 2020-11-20T12:14:30.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.405+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141814ef40 con 0x7f1418061870 2020-11-20T12:14:30.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.406+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141814dd10 con 0x7f1418061870 2020-11-20T12:14:30.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.407+0000 7f14157fa700 1 -- 172.21.15.160:0/2725637683 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f140c024030 con 0x7f1418061870 2020-11-20T12:14:30.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.408+0000 7f14157fa700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f13f0080630 0x7f13f0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.408+0000 7f14157fa700 1 -- 172.21.15.160:0/2725637683 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f140c0a45c0 con 0x7f1418061870 2020-11-20T12:14:30.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.408+0000 7f141cbd3700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f13f0080630 0x7f13f0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.409+0000 7f141cbd3700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f13f0080630 0x7f13f0082af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1404007fd0 tx=0x7f1404009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:30.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.410+0000 7f14157fa700 1 -- 172.21.15.160:0/2725637683 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f140c079240 con 0x7f1418061870 2020-11-20T12:14:30.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.670+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1418044f60 con 0x7f1418061870 2020-11-20T12:14:30.674 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.671+0000 7f14157fa700 1 -- 172.21.15.160:0/2725637683 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f140c022070 con 0x7f1418061870 2020-11-20T12:14:30.674 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:30.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.673+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f13f0080630 msgr2=0x7f13f0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.673+0000 7f141e3d6700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f13f0080630 0x7f13f0082af0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1404007fd0 tx=0x7f1404009040).stop 2020-11-20T12:14:30.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.673+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 msgr2=0x7f1418149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.673+0000 7f141e3d6700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418149ce0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f140c009210 tx=0x7f140c016000).stop 2020-11-20T12:14:30.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 shutdown_connections 2020-11-20T12:14:30.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f13f0080630 0x7f13f0082af0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14180c0510 0x7f1418164180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1418061870 0x7f1418149ce0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 --2- 172.21.15.160:0/2725637683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14180bb9b0 0x7f1418154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 >> 172.21.15.160:0/2725637683 conn(0x7f1418062ef0 msgr2=0x7f14180be670 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:30.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 shutdown_connections 2020-11-20T12:14:30.680 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.674+0000 7f141e3d6700 1 -- 172.21.15.160:0/2725637683 wait complete. 2020-11-20T12:14:30.702 INFO:teuthology.orchestra.run.smithi160.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T12:14:30.702 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T12:14:30.703 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:30.964 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.960+0000 7fa8190e5700 1 Processor -- start 2020-11-20T12:14:30.965 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.960+0000 7fa8190e5700 1 -- start start 2020-11-20T12:14:30.966 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.962+0000 7fa8190e5700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa814067270 0x7fa814067650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.962+0000 7fa8190e5700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa814151760 0x7fa8140637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.962+0000 7fa8190e5700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa814063cd0 con 0x7fa814064550 2020-11-20T12:14:30.967 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.962+0000 7fa8190e5700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa814063f10 con 0x7fa814151760 2020-11-20T12:14:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.962+0000 7fa8190e5700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8140ba680 con 0x7fa814067270 2020-11-20T12:14:30.968 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.962+0000 7fa813fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa814067270 0x7fa814067650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa813fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fa814067270 0x7fa814067650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38348/0 (socket says 172.21.15.160:38348) 2020-11-20T12:14:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa813fff700 1 -- 172.21.15.160:0/3404281084 learned_addr learned my addr 172.21.15.160:0/3404281084 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:30.969 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa80b7fe700 1 --2- 172.21.15.160:0/3404281084 >> v2:172.21.15.134:3300/0 conn(0x7fa814151760 0x7fa8140637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.970 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa8137fe700 1 -- 172.21.15.160:0/3404281084 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 583777099 0 0) 0x7fa80c001450 con 0x7fa814064550 2020-11-20T12:14:30.970 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa8137fe700 1 -- 172.21.15.160:0/3404281084 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f4003240 con 0x7fa814064550 2020-11-20T12:14:30.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa813fff700 1 -- 172.21.15.160:0/3404281084 >> v2:172.21.15.134:3300/0 conn(0x7fa814151760 msgr2=0x7fa8140637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:30.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa813fff700 1 --2- 172.21.15.160:0/3404281084 >> v2:172.21.15.134:3300/0 conn(0x7fa814151760 0x7fa8140637e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.971 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa813fff700 1 -- 172.21.15.160:0/3404281084 >> v1:172.21.15.150:6789/0 conn(0x7fa814064550 legacy=0x7fa8141520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.976 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa813fff700 1 -- 172.21.15.160:0/3404281084 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140ba920 con 0x7fa814067270 2020-11-20T12:14:30.977 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.963+0000 7fa813fff700 1 --2- 172.21.15.160:0/3404281084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814067270 0x7fa814067650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa8140c6190 tx=0x7fa804006eb0).ready entity=mon.2 client_cookie=28a4b0cf8615f778 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:30.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8137fe700 1 -- 172.21.15.160:0/3404281084 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040097b0 con 0x7fa814067270 2020-11-20T12:14:30.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8137fe700 1 -- 172.21.15.160:0/3404281084 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa804009910 con 0x7fa814067270 2020-11-20T12:14:30.978 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8137fe700 1 -- 172.21.15.160:0/3404281084 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804009c90 con 0x7fa814067270 2020-11-20T12:14:30.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 -- 172.21.15.160:0/3404281084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814067270 msgr2=0x7fa814067650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.979 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3404281084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814067270 0x7fa814067650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa8140c6190 tx=0x7fa804006eb0).stop 2020-11-20T12:14:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 -- 172.21.15.160:0/3404281084 shutdown_connections 2020-11-20T12:14:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3404281084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814067270 0x7fa814067650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.980 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3404281084 >> v2:172.21.15.134:3300/0 conn(0x7fa814151760 0x7fa8140637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 -- 172.21.15.160:0/3404281084 >> 172.21.15.160:0/3404281084 conn(0x7fa814060140 msgr2=0x7fa814060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:30.981 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 -- 172.21.15.160:0/3404281084 shutdown_connections 2020-11-20T12:14:30.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.964+0000 7fa8190e5700 1 -- 172.21.15.160:0/3404281084 wait complete. 2020-11-20T12:14:30.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.966+0000 7fa8190e5700 1 Processor -- start 2020-11-20T12:14:30.982 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.967+0000 7fa8190e5700 1 -- start start 2020-11-20T12:14:30.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa8190e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa814064550 0x7fa814160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa8190e5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814067270 0x7fa814116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.983 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa8190e5700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814151760 0x7fa8140c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa8190e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814160d80 con 0x7fa814064550 2020-11-20T12:14:30.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa8190e5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa814163540 con 0x7fa814067270 2020-11-20T12:14:30.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa8190e5700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8141637e0 con 0x7fa814151760 2020-11-20T12:14:30.984 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa813fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa814064550 0x7fa814160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa813fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa814064550 0x7fa814160890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60876/0 (socket says 172.21.15.160:60876) 2020-11-20T12:14:30.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814067270 0x7fa814116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.985 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa8188e4700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814151760 0x7fa8140c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.968+0000 7fa813fff700 1 -- 172.21.15.160:0/3736197354 learned_addr learned my addr 172.21.15.160:0/3736197354 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:30.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa813fff700 1 -- 172.21.15.160:0/3736197354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814151760 msgr2=0x7fa8140c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.986 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa813fff700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814151760 0x7fa8140c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa813fff700 1 -- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814067270 msgr2=0x7fa814116300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:30.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa813fff700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814067270 0x7fa814116300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:30.987 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa813fff700 1 -- 172.21.15.160:0/3736197354 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa814163a80 con 0x7fa814064550 2020-11-20T12:14:30.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa8188e4700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814151760 0x7fa8140c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:30.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa813fff700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa814064550 0x7fa814160890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa804006ef0 tx=0x7fa804015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:30.988 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa810ff9700 1 -- 172.21.15.160:0/3736197354 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804011c80 con 0x7fa814064550 2020-11-20T12:14:30.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa810ff9700 1 -- 172.21.15.160:0/3736197354 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa804011de0 con 0x7fa814064550 2020-11-20T12:14:30.989 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa814163d20 con 0x7fa814064550 2020-11-20T12:14:30.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa810ff9700 1 -- 172.21.15.160:0/3736197354 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80401e690 con 0x7fa814064550 2020-11-20T12:14:30.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.969+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa814151100 con 0x7fa814064550 2020-11-20T12:14:30.990 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.970+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa814044f60 con 0x7fa814064550 2020-11-20T12:14:30.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.971+0000 7fa810ff9700 1 -- 172.21.15.160:0/3736197354 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa804025030 con 0x7fa814064550 2020-11-20T12:14:30.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.972+0000 7fa810ff9700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa7f0080630 0x7fa7f0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:30.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.972+0000 7fa810ff9700 1 -- 172.21.15.160:0/3736197354 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fa8040a40f0 con 0x7fa814064550 2020-11-20T12:14:30.991 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.973+0000 7fa80b7fe700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa7f0080630 0x7fa7f0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:30.993 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.973+0000 7fa80b7fe700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa7f0080630 0x7fa7f0082af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa8140c50c0 tx=0x7fa7fc006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:30.993 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:30.974+0000 7fa810ff9700 1 -- 172.21.15.160:0/3736197354 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa804078cf0 con 0x7fa814064550 2020-11-20T12:14:31.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.160+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa81405c2a0 con 0x7fa814064550 2020-11-20T12:14:31.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.162+0000 7fa810ff9700 1 -- 172.21.15.160:0/3736197354 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7fa804023020 con 0x7fa814064550 2020-11-20T12:14:31.166 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:31.166 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:31.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa7f0080630 msgr2=0x7fa7f0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa7f0080630 0x7fa7f0082af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa8140c50c0 tx=0x7fa7fc006df0).stop 2020-11-20T12:14:31.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa814064550 msgr2=0x7fa814160890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa814064550 0x7fa814160890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa804006ef0 tx=0x7fa804015000).stop 2020-11-20T12:14:31.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 shutdown_connections 2020-11-20T12:14:31.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa7f0080630 0x7fa7f0082af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa814151760 0x7fa8140c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa814064550 0x7fa814160890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 --2- 172.21.15.160:0/3736197354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa814067270 0x7fa814116300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.164+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 >> 172.21.15.160:0/3736197354 conn(0x7fa814060140 msgr2=0x7fa81414a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:31.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.165+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 shutdown_connections 2020-11-20T12:14:31.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.165+0000 7fa8190e5700 1 -- 172.21.15.160:0/3736197354 wait complete. 2020-11-20T12:14:31.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:13:54.112655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:04.811782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T12:14:08.565233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T12:14:09.890329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T12:14:31.194 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:31.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.433+0000 7f7512bef700 1 Processor -- start 2020-11-20T12:14:31.437 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.433+0000 7f7512bef700 1 -- start start 2020-11-20T12:14:31.438 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.435+0000 7f7512bef700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f750c061870 0x7f750c061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.435+0000 7f7512bef700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c065dc0 con 0x7f750c0bb650 2020-11-20T12:14:31.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.435+0000 7f7512bef700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c0bbae0 con 0x7f750c0bcf40 2020-11-20T12:14:31.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.435+0000 7f7512bef700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c0bbd80 con 0x7f750c061870 2020-11-20T12:14:31.439 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.435+0000 7f75123ee700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f750c0bcf40 0x7f750c0656b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:55944/0 (socket says 172.21.15.160:55944) 2020-11-20T12:14:31.440 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.435+0000 7f75123ee700 1 -- 172.21.15.160:0/2528085312 learned_addr learned my addr 172.21.15.160:0/2528085312 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:31.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375092367 0 0) 0x7f750c065dc0 con 0x7f750c0bb650 2020-11-20T12:14:31.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f4003240 con 0x7f750c0bb650 2020-11-20T12:14:31.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7511bed700 1 --2- 172.21.15.160:0/2528085312 >> v2:172.21.15.160:3300/0 conn(0x7f750c061870 0x7f750c061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1574487443 0 0) 0x7f74f4003240 con 0x7f750c0bb650 2020-11-20T12:14:31.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 >> v2:172.21.15.160:3300/0 conn(0x7f750c061870 msgr2=0x7f750c061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:31.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 --2- 172.21.15.160:0/2528085312 >> v2:172.21.15.160:3300/0 conn(0x7f750c061870 0x7f750c061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 >> v1:172.21.15.160:6789/0 conn(0x7f750c0bcf40 legacy=0x7f750c0656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0bc560 con 0x7f750c0bb650 2020-11-20T12:14:31.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f74fc0014e0 con 0x7f750c0bb650 2020-11-20T12:14:31.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7511bed700 1 --2- 172.21.15.160:0/2528085312 >> v2:172.21.15.160:3300/0 conn(0x7f750c061870 0x7f750c061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:31.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 >> v1:172.21.15.150:6789/0 conn(0x7f750c0bb650 legacy=0x7f750c064fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74f4003730 0x7f74f4003b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74f40044e0 0x7f74f4004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4004e50 0x7f74f400b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0bbd80 con 0x7f74f4004e50 2020-11-20T12:14:31.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f4004220 con 0x7f74f40044e0 2020-11-20T12:14:31.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.436+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f400bc20 con 0x7f74f4003730 2020-11-20T12:14:31.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f7511bed700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74f4003730 0x7f74f4003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75113ec700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74f40044e0 0x7f74f4004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75123ee700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4004e50 0x7f74f400b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75113ec700 1 -- 172.21.15.160:0/2528085312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74f4003730 msgr2=0x7f74f4003b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:31.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75113ec700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74f4003730 0x7f74f4003b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75113ec700 1 -- 172.21.15.160:0/2528085312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4004e50 msgr2=0x7f74f400b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:31.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75113ec700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4004e50 0x7f74f400b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75113ec700 1 -- 172.21.15.160:0/2528085312 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f4003240 con 0x7f74f40044e0 2020-11-20T12:14:31.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75123ee700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f4004e50 0x7f74f400b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:31.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f7511bed700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74f4003730 0x7f74f4003b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:31.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75123ee700 1 -- 172.21.15.160:0/2528085312 reap_dead start 2020-11-20T12:14:31.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.437+0000 7f75113ec700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74f40044e0 0x7f74f4004960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f74fc00c1e0 tx=0x7f750c0bbc70).ready entity=mon.1 client_cookie=5c39b6b4b12ed485 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:31.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc007030 con 0x7f74f40044e0 2020-11-20T12:14:31.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc007190 con 0x7f74f40044e0 2020-11-20T12:14:31.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7510beb700 1 -- 172.21.15.160:0/2528085312 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0064f0 con 0x7f74f40044e0 2020-11-20T12:14:31.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7512bef700 1 -- 172.21.15.160:0/2528085312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74f40044e0 msgr2=0x7f74f4004960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7512bef700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74f40044e0 0x7f74f4004960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f74fc00c1e0 tx=0x7f750c0bbc70).stop 2020-11-20T12:14:31.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7512bef700 1 -- 172.21.15.160:0/2528085312 shutdown_connections 2020-11-20T12:14:31.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7512bef700 1 --2- 172.21.15.160:0/2528085312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f74f40044e0 0x7f74f4004960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7512bef700 1 -- 172.21.15.160:0/2528085312 >> 172.21.15.160:0/2528085312 conn(0x7f750c060140 msgr2=0x7f750c060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:31.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7512bef700 1 -- 172.21.15.160:0/2528085312 shutdown_connections 2020-11-20T12:14:31.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.438+0000 7f7512bef700 1 -- 172.21.15.160:0/2528085312 wait complete. 2020-11-20T12:14:31.453 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.440+0000 7f7512bef700 1 Processor -- start 2020-11-20T12:14:31.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.441+0000 7f7512bef700 1 -- start start 2020-11-20T12:14:31.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f7512bef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f40044e0 0x7f750c133090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f7512bef700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f750c140780 0x7f750c164880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f7512bef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f750c14b4b0 0x7f750c13fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.454 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f7512bef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c140c50 con 0x7f74f40044e0 2020-11-20T12:14:31.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f7512bef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c140ef0 con 0x7f750c14b4b0 2020-11-20T12:14:31.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f7512bef700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c141190 con 0x7f750c140780 2020-11-20T12:14:31.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f75113ec700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f750c140780 0x7f750c164880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f75123ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f750c14b4b0 0x7f750c13fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.455 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f7511bed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f40044e0 0x7f750c133090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f75113ec700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f750c140780 0x7f750c164880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38376/0 (socket says 172.21.15.160:38376) 2020-11-20T12:14:31.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.442+0000 7f75113ec700 1 -- 172.21.15.160:0/2478706981 learned_addr learned my addr 172.21.15.160:0/2478706981 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:31.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f75113ec700 1 -- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f750c14b4b0 msgr2=0x7f750c13fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f75113ec700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f750c14b4b0 0x7f750c13fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f75113ec700 1 -- 172.21.15.160:0/2478706981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f40044e0 msgr2=0x7f750c133090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f75113ec700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f40044e0 0x7f750c133090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f75113ec700 1 -- 172.21.15.160:0/2478706981 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c141430 con 0x7f750c140780 2020-11-20T12:14:31.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f75113ec700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f750c140780 0x7f750c164880 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f74fc000bc0 tx=0x7f74fc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:31.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f74f9ffb700 1 -- 172.21.15.160:0/2478706981 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc006ed0 con 0x7f750c140780 2020-11-20T12:14:31.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f74f9ffb700 1 -- 172.21.15.160:0/2478706981 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc013410 con 0x7f750c140780 2020-11-20T12:14:31.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c164140 con 0x7f750c140780 2020-11-20T12:14:31.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f74f9ffb700 1 -- 172.21.15.160:0/2478706981 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc007030 con 0x7f750c140780 2020-11-20T12:14:31.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.443+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c0c2a60 con 0x7f750c140780 2020-11-20T12:14:31.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.445+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c1645a0 con 0x7f750c140780 2020-11-20T12:14:31.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.446+0000 7f74f9ffb700 1 -- 172.21.15.160:0/2478706981 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f74fc025030 con 0x7f750c140780 2020-11-20T12:14:31.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.447+0000 7f74f9ffb700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f74e4080630 0x7f74e4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.447+0000 7f74f9ffb700 1 -- 172.21.15.160:0/2478706981 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f74fc0a3e50 con 0x7f750c140780 2020-11-20T12:14:31.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.447+0000 7f7511bed700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f74e4080630 0x7f74e4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.448+0000 7f7511bed700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f74e4080630 0x7f74e4082af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f750800a310 tx=0x7f7508008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:31.460 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.450+0000 7f74f9ffb700 1 -- 172.21.15.160:0/2478706981 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f74fc0789d0 con 0x7f750c140780 2020-11-20T12:14:31.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.626+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f750c0bc740 con 0x7f750c140780 2020-11-20T12:14:31.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.627+0000 7f74f9ffb700 1 -- 172.21.15.160:0/2478706981 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f74fc023030 con 0x7f750c140780 2020-11-20T12:14:31.631 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 1 2020-11-20T12:14:31.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f74e4080630 msgr2=0x7f74e4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f74e4080630 0x7f74e4082af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f750800a310 tx=0x7f7508008040).stop 2020-11-20T12:14:31.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f750c140780 msgr2=0x7f750c164880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f750c140780 0x7f750c164880 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f74fc000bc0 tx=0x7f74fc016000).stop 2020-11-20T12:14:31.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 shutdown_connections 2020-11-20T12:14:31.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f74e4080630 0x7f74e4082af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f750c14b4b0 0x7f750c13fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74f40044e0 0x7f750c133090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 --2- 172.21.15.160:0/2478706981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f750c140780 0x7f750c164880 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.630+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 >> 172.21.15.160:0/2478706981 conn(0x7f750c060140 msgr2=0x7f750c0be7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:31.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.631+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 shutdown_connections 2020-11-20T12:14:31.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.631+0000 7f7512bef700 1 -- 172.21.15.160:0/2478706981 wait complete. 2020-11-20T12:14:31.657 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:31.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.893+0000 7f4d66d01700 1 Processor -- start 2020-11-20T12:14:31.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.893+0000 7f4d66d01700 1 -- start start 2020-11-20T12:14:31.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.895+0000 7f4d66d01700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d601592a0 0x7f4d600be030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.895+0000 7f4d66d01700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d600bef40 con 0x7f4d60152060 2020-11-20T12:14:31.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.895+0000 7f4d66d01700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d601554e0 con 0x7f4d600bdc50 2020-11-20T12:14:31.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.895+0000 7f4d66d01700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d60155780 con 0x7f4d601592a0 2020-11-20T12:14:31.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.895+0000 7f4d65cff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f4d600bdc50 0x7f4d600badd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47226/0 (socket says 172.21.15.160:47226) 2020-11-20T12:14:31.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.895+0000 7f4d654fe700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f4d601592a0 0x7f4d600be030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.895+0000 7f4d65cff700 1 -- 172.21.15.160:0/1996873037 learned_addr learned my addr 172.21.15.160:0/1996873037 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:31.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d654fe700 1 -- 172.21.15.160:0/1996873037 >> v1:172.21.15.150:6789/0 conn(0x7f4d600bdc50 legacy=0x7f4d600badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d654fe700 1 -- 172.21.15.160:0/1996873037 >> v1:172.21.15.134:6789/0 conn(0x7f4d60152060 legacy=0x7f4d60152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d64cfd700 1 -- 172.21.15.160:0/1996873037 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794870923 0 0) 0x7f4d601554e0 con 0x7f4d600bdc50 2020-11-20T12:14:31.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d654fe700 1 -- 172.21.15.160:0/1996873037 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60155a20 con 0x7f4d601592a0 2020-11-20T12:14:31.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d654fe700 1 --2- 172.21.15.160:0/1996873037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d601592a0 0x7f4d600be030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4d5000b9a0 tx=0x7f4d50006df0).ready entity=mon.0 client_cookie=7761dfc097cbf1d8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:31.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d64cfd700 1 -- 172.21.15.160:0/1996873037 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d500096b0 con 0x7f4d601592a0 2020-11-20T12:14:31.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d64cfd700 1 -- 172.21.15.160:0/1996873037 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d50009810 con 0x7f4d601592a0 2020-11-20T12:14:31.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.896+0000 7f4d64cfd700 1 -- 172.21.15.160:0/1996873037 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50009b90 con 0x7f4d601592a0 2020-11-20T12:14:31.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.897+0000 7f4d66d01700 1 -- 172.21.15.160:0/1996873037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d601592a0 msgr2=0x7f4d600be030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.897+0000 7f4d66d01700 1 --2- 172.21.15.160:0/1996873037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d601592a0 0x7f4d600be030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4d5000b9a0 tx=0x7f4d50006df0).stop 2020-11-20T12:14:31.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.897+0000 7f4d66d01700 1 -- 172.21.15.160:0/1996873037 shutdown_connections 2020-11-20T12:14:31.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.897+0000 7f4d66d01700 1 --2- 172.21.15.160:0/1996873037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d601592a0 0x7f4d600be030 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.897+0000 7f4d66d01700 1 -- 172.21.15.160:0/1996873037 >> 172.21.15.160:0/1996873037 conn(0x7f4d60060140 msgr2=0x7f4d60060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:31.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.897+0000 7f4d66d01700 1 -- 172.21.15.160:0/1996873037 shutdown_connections 2020-11-20T12:14:31.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.897+0000 7f4d66d01700 1 -- 172.21.15.160:0/1996873037 wait complete. 2020-11-20T12:14:31.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.898+0000 7f4d66d01700 1 Processor -- start 2020-11-20T12:14:31.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.898+0000 7f4d66d01700 1 -- start start 2020-11-20T12:14:31.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.899+0000 7f4d66d01700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d600bdc50 0x7f4d600c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.899+0000 7f4d66d01700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d60152060 0x7f4d60164e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.899+0000 7f4d66d01700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d601592a0 0x7f4d60065230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.899+0000 7f4d66d01700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600c3930 con 0x7f4d600bdc50 2020-11-20T12:14:31.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.899+0000 7f4d66d01700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d601652f0 con 0x7f4d60152060 2020-11-20T12:14:31.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.899+0000 7f4d66d01700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d600c3b70 con 0x7f4d601592a0 2020-11-20T12:14:31.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d600bdc50 0x7f4d600c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d600bdc50 0x7f4d600c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60910/0 (socket says 172.21.15.160:60910) 2020-11-20T12:14:31.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 -- 172.21.15.160:0/366961310 learned_addr learned my addr 172.21.15.160:0/366961310 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:31.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d654fe700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d60152060 0x7f4d60164e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d66500700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d601592a0 0x7f4d60065230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 -- 172.21.15.160:0/366961310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d601592a0 msgr2=0x7f4d60065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d601592a0 0x7f4d60065230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 -- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d60152060 msgr2=0x7f4d60164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:31.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d60152060 0x7f4d60164e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:31.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 -- 172.21.15.160:0/366961310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60167b30 con 0x7f4d600bdc50 2020-11-20T12:14:31.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.900+0000 7f4d65cff700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d600bdc50 0x7f4d600c3440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4d5c00c760 tx=0x7f4d5c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:31.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.901+0000 7f4d4dffb700 1 -- 172.21.15.160:0/366961310 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0072e0 con 0x7f4d600bdc50 2020-11-20T12:14:31.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.901+0000 7f4d4dffb700 1 -- 172.21.15.160:0/366961310 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c007440 con 0x7f4d600bdc50 2020-11-20T12:14:31.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.901+0000 7f4d4dffb700 1 -- 172.21.15.160:0/366961310 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c005820 con 0x7f4d600bdc50 2020-11-20T12:14:31.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.901+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d60167dd0 con 0x7f4d600bdc50 2020-11-20T12:14:31.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.901+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d60168310 con 0x7f4d600bdc50 2020-11-20T12:14:31.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.902+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d60044f60 con 0x7f4d600bdc50 2020-11-20T12:14:31.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.903+0000 7f4d4dffb700 1 -- 172.21.15.160:0/366961310 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f4d5c010070 con 0x7f4d600bdc50 2020-11-20T12:14:31.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.904+0000 7f4d4dffb700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4d38080630 0x7f4d38082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:31.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.904+0000 7f4d4dffb700 1 -- 172.21.15.160:0/366961310 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f4d5c0a1f30 con 0x7f4d600bdc50 2020-11-20T12:14:31.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.904+0000 7f4d654fe700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4d38080630 0x7f4d38082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:31.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.905+0000 7f4d654fe700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4d38080630 0x7f4d38082af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4d5000b9a0 tx=0x7f4d50015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:31.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:31.908+0000 7f4d4dffb700 1 -- 172.21.15.160:0/366961310 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f4d5c076b30 con 0x7f4d600bdc50 2020-11-20T12:14:32.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.091+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d60111860 con 0x7f4d600bdc50 2020-11-20T12:14:32.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.092+0000 7f4d4dffb700 1 -- 172.21.15.160:0/366961310 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d5c07a150 con 0x7f4d600bdc50 2020-11-20T12:14:32.096 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:32.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4d38080630 msgr2=0x7f4d38082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4d38080630 0x7f4d38082af0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f4d5000b9a0 tx=0x7f4d50015000).stop 2020-11-20T12:14:32.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d600bdc50 msgr2=0x7f4d600c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d600bdc50 0x7f4d600c3440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f4d5c00c760 tx=0x7f4d5c007a60).stop 2020-11-20T12:14:32.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 shutdown_connections 2020-11-20T12:14:32.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f4d38080630 0x7f4d38082af0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d601592a0 0x7f4d60065230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d600bdc50 0x7f4d600c3440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 --2- 172.21.15.160:0/366961310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d60152060 0x7f4d60164e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 >> 172.21.15.160:0/366961310 conn(0x7f4d60060140 msgr2=0x7f4d600c0210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 shutdown_connections 2020-11-20T12:14:32.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.094+0000 7f4d66d01700 1 -- 172.21.15.160:0/366961310 wait complete. 2020-11-20T12:14:32.120 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T12:14:32.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.345+0000 7f758a654700 1 Processor -- start 2020-11-20T12:14:32.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.345+0000 7f758a654700 1 -- start start 2020-11-20T12:14:32.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f758a654700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f7584151bc0 0x7f75840bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f758a654700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f75840c2070 0x7f7584154780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f758a654700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840c25b0 con 0x7f75840bf720 2020-11-20T12:14:32.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f758a654700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840c2850 con 0x7f7584151bc0 2020-11-20T12:14:32.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f758a654700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840c2af0 con 0x7f75840c2070 2020-11-20T12:14:32.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f7589e53700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f75840c2070 0x7f7584154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f7589e53700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f75840c2070 0x7f7584154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38398/0 (socket says 172.21.15.160:38398) 2020-11-20T12:14:32.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f7589e53700 1 -- 172.21.15.160:0/3542194151 learned_addr learned my addr 172.21.15.160:0/3542194151 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.347+0000 7f7588e51700 1 --2- 172.21.15.160:0/3542194151 >> v2:172.21.15.134:3300/0 conn(0x7f7584151bc0 0x7f75840bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755558090 0 0) 0x7f75840c25b0 con 0x7f75840bf720 2020-11-20T12:14:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f756c003240 con 0x7f75840bf720 2020-11-20T12:14:32.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 <== mon.0 v1:172.21.15.134:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2818973301 0 0) 0x7f756c003240 con 0x7f75840bf720 2020-11-20T12:14:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 >> v2:172.21.15.160:3300/0 conn(0x7f75840c2070 msgr2=0x7f7584154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 --2- 172.21.15.160:0/3542194151 >> v2:172.21.15.160:3300/0 conn(0x7f75840c2070 0x7f7584154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 >> v2:172.21.15.134:3300/0 conn(0x7f7584151bc0 msgr2=0x7f75840bfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 --2- 172.21.15.160:0/3542194151 >> v2:172.21.15.134:3300/0 conn(0x7f7584151bc0 0x7f75840bfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 --> v1:172.21.15.134:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840c2d90 con 0x7f75840bf720 2020-11-20T12:14:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 <== mon.0 v1:172.21.15.134:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f75800014e0 con 0x7f75840bf720 2020-11-20T12:14:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 >> v1:172.21.15.134:6789/0 conn(0x7f75840bf720 legacy=0x7f75841514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f756c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f756c0044e0 0x7f756c004960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c004e50 0x7f756c00b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840c2850 con 0x7f756c0044e0 2020-11-20T12:14:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75840c2af0 con 0x7f756c003780 2020-11-20T12:14:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.348+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756c005300 con 0x7f756c004e50 2020-11-20T12:14:32.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589652700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f756c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589e53700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c004e50 0x7f756c00b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589652700 1 -- 172.21.15.160:0/3542194151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c004e50 msgr2=0x7f756c00b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589652700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f756c004e50 0x7f756c00b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7588e51700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f756c0044e0 0x7f756c004960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589652700 1 -- 172.21.15.160:0/3542194151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f756c0044e0 msgr2=0x7f756c004960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589652700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f756c0044e0 0x7f756c004960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589e53700 1 -- 172.21.15.160:0/3542194151 reap_dead start 2020-11-20T12:14:32.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589652700 1 -- 172.21.15.160:0/3542194151 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c003240 con 0x7f756c003780 2020-11-20T12:14:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7588e51700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f756c0044e0 0x7f756c004960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.349+0000 7f7589652700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f756c003ba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f758000c210 tx=0x7f75840c2740).ready entity=mon.1 client_cookie=838cc2990e46ddb5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580007030 con 0x7f756c003780 2020-11-20T12:14:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580007190 con 0x7f756c003780 2020-11-20T12:14:32.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f7573fff700 1 -- 172.21.15.160:0/3542194151 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800064f0 con 0x7f756c003780 2020-11-20T12:14:32.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f758a654700 1 -- 172.21.15.160:0/3542194151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 msgr2=0x7f756c003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f758a654700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f756c003ba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f758000c210 tx=0x7f75840c2740).stop 2020-11-20T12:14:32.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f758a654700 1 -- 172.21.15.160:0/3542194151 shutdown_connections 2020-11-20T12:14:32.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f758a654700 1 --2- 172.21.15.160:0/3542194151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f756c003ba0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f758a654700 1 -- 172.21.15.160:0/3542194151 >> 172.21.15.160:0/3542194151 conn(0x7f7584060140 msgr2=0x7f7584060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f758a654700 1 -- 172.21.15.160:0/3542194151 shutdown_connections 2020-11-20T12:14:32.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.350+0000 7f758a654700 1 -- 172.21.15.160:0/3542194151 wait complete. 2020-11-20T12:14:32.365 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.352+0000 7f758a654700 1 Processor -- start 2020-11-20T12:14:32.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.352+0000 7f758a654700 1 -- start start 2020-11-20T12:14:32.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f758a654700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f7584153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f758a654700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75840c63b0 0x7f75841609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f758a654700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7584061870 0x7f7584112180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f758a654700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584153830 con 0x7f7584061870 2020-11-20T12:14:32.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f758a654700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584153ad0 con 0x7f756c003780 2020-11-20T12:14:32.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f758a654700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7584153d70 con 0x7f75840c63b0 2020-11-20T12:14:32.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f7588e51700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75840c63b0 0x7f75841609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.368 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f7589652700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f7584153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.368 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f7588e51700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75840c63b0 0x7f75841609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38410/0 (socket says 172.21.15.160:38410) 2020-11-20T12:14:32.368 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f7589652700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f7584153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51544/0 (socket says 172.21.15.160:51544) 2020-11-20T12:14:32.368 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f7588e51700 1 -- 172.21.15.160:0/975988204 learned_addr learned my addr 172.21.15.160:0/975988204 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:32.368 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.353+0000 7f7589e53700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7584061870 0x7f7584112180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7589652700 1 -- 172.21.15.160:0/975988204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75840c63b0 msgr2=0x7f75841609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7589652700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75840c63b0 0x7f75841609f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7589652700 1 -- 172.21.15.160:0/975988204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7584061870 msgr2=0x7f7584112180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7589652700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7584061870 0x7f7584112180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.370 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7589652700 1 -- 172.21.15.160:0/975988204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75841602b0 con 0x7f756c003780 2020-11-20T12:14:32.370 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7589e53700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7584061870 0x7f7584112180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:32.370 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7588e51700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75840c63b0 0x7f75841609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:32.370 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f7589652700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f7584153250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7580007530 tx=0x7f7580016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.370 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f75717fa700 1 -- 172.21.15.160:0/975988204 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580006d90 con 0x7f756c003780 2020-11-20T12:14:32.371 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f75717fa700 1 -- 172.21.15.160:0/975988204 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7580006ef0 con 0x7f756c003780 2020-11-20T12:14:32.371 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7584160550 con 0x7f756c003780 2020-11-20T12:14:32.371 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f75717fa700 1 -- 172.21.15.160:0/975988204 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758001e6c0 con 0x7f756c003780 2020-11-20T12:14:32.371 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.354+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7584160ee0 con 0x7f756c003780 2020-11-20T12:14:32.371 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.355+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75840c6790 con 0x7f756c003780 2020-11-20T12:14:32.372 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.357+0000 7f75717fa700 1 -- 172.21.15.160:0/975988204 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7580025030 con 0x7f756c003780 2020-11-20T12:14:32.372 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.358+0000 7f75717fa700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f755c080660 0x7f755c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.372 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.358+0000 7f75717fa700 1 -- 172.21.15.160:0/975988204 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f75800a4370 con 0x7f756c003780 2020-11-20T12:14:32.372 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.358+0000 7f7588e51700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f755c080660 0x7f755c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.372 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.359+0000 7f7588e51700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f755c080660 0x7f755c082b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7574006d00 tx=0x7f7574008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.373 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.360+0000 7f75717fa700 1 -- 172.21.15.160:0/975988204 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7580078e60 con 0x7f756c003780 2020-11-20T12:14:32.534 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.531+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75840611e0 con 0x7f756c003780 2020-11-20T12:14:32.535 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.531+0000 7f75717fa700 1 -- 172.21.15.160:0/975988204 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7580023070 con 0x7f756c003780 2020-11-20T12:14:32.535 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:32.537 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f755c080660 msgr2=0x7f755c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.538 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f755c080660 0x7f755c082b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7574006d00 tx=0x7f7574008040).stop 2020-11-20T12:14:32.538 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 msgr2=0x7f7584153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.538 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f7584153250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f7580007530 tx=0x7f7580016000).stop 2020-11-20T12:14:32.538 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 shutdown_connections 2020-11-20T12:14:32.539 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f755c080660 0x7f755c082b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.539 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7584061870 0x7f7584112180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.539 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f756c003780 0x7f7584153250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.539 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 --2- 172.21.15.160:0/975988204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75840c63b0 0x7f75841609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.539 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 >> 172.21.15.160:0/975988204 conn(0x7f7584060140 msgr2=0x7f7584064f70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.540 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 shutdown_connections 2020-11-20T12:14:32.540 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.534+0000 7f758a654700 1 -- 172.21.15.160:0/975988204 wait complete. 2020-11-20T12:14:32.558 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T12:14:32.798 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.794+0000 7f7a32aeb700 1 Processor -- start 2020-11-20T12:14:32.798 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.795+0000 7f7a32aeb700 1 -- start start 2020-11-20T12:14:32.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.796+0000 7f7a32aeb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f7a2c151bc0 0x7f7a2c0bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.796+0000 7f7a32aeb700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0c25b0 con 0x7f7a2c0bf720 2020-11-20T12:14:32.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.796+0000 7f7a32aeb700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0c2850 con 0x7f7a2c0c2070 2020-11-20T12:14:32.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.796+0000 7f7a32aeb700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c0c2af0 con 0x7f7a2c151bc0 2020-11-20T12:14:32.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a31ae9700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f7a2c0bf720 0x7f7a2c1514b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60724/0 (socket says 172.21.15.160:60724) 2020-11-20T12:14:32.802 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a31ae9700 1 -- 172.21.15.160:0/3413215308 learned_addr learned my addr 172.21.15.160:0/3413215308 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:32.802 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a312e8700 1 --2- 172.21.15.160:0/3413215308 >> v2:172.21.15.150:3300/0 conn(0x7f7a2c151bc0 0x7f7a2c0bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.802 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a30ae7700 1 -- 172.21.15.160:0/3413215308 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128790819 0 0) 0x7f7a2c0c25b0 con 0x7f7a2c0bf720 2020-11-20T12:14:32.802 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a30ae7700 1 -- 172.21.15.160:0/3413215308 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a14003240 con 0x7f7a2c0bf720 2020-11-20T12:14:32.803 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a312e8700 1 -- 172.21.15.160:0/3413215308 >> v1:172.21.15.150:6789/0 conn(0x7f7a2c0c2070 legacy=0x7f7a2c154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.803 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a312e8700 1 -- 172.21.15.160:0/3413215308 >> v1:172.21.15.134:6789/0 conn(0x7f7a2c0bf720 legacy=0x7f7a2c1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.803 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a312e8700 1 -- 172.21.15.160:0/3413215308 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c0c2d90 con 0x7f7a2c151bc0 2020-11-20T12:14:32.803 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.797+0000 7f7a312e8700 1 --2- 172.21.15.160:0/3413215308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c151bc0 0x7f7a2c0bfb00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7a1c00b9d0 tx=0x7f7a1c006df0).ready entity=mon.1 client_cookie=39808885e504c704 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.803 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a30ae7700 1 -- 172.21.15.160:0/3413215308 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c009770 con 0x7f7a2c151bc0 2020-11-20T12:14:32.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a30ae7700 1 -- 172.21.15.160:0/3413215308 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1c0098d0 con 0x7f7a2c151bc0 2020-11-20T12:14:32.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a30ae7700 1 -- 172.21.15.160:0/3413215308 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c009c50 con 0x7f7a2c151bc0 2020-11-20T12:14:32.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a32aeb700 1 -- 172.21.15.160:0/3413215308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c151bc0 msgr2=0x7f7a2c0bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/3413215308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c151bc0 0x7f7a2c0bfb00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f7a1c00b9d0 tx=0x7f7a1c006df0).stop 2020-11-20T12:14:32.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a32aeb700 1 -- 172.21.15.160:0/3413215308 shutdown_connections 2020-11-20T12:14:32.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/3413215308 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c151bc0 0x7f7a2c0bfb00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a32aeb700 1 -- 172.21.15.160:0/3413215308 >> 172.21.15.160:0/3413215308 conn(0x7f7a2c060140 msgr2=0x7f7a2c060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.806 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a32aeb700 1 -- 172.21.15.160:0/3413215308 shutdown_connections 2020-11-20T12:14:32.806 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.798+0000 7f7a32aeb700 1 -- 172.21.15.160:0/3413215308 wait complete. 2020-11-20T12:14:32.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.800+0000 7f7a32aeb700 1 Processor -- start 2020-11-20T12:14:32.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.800+0000 7f7a32aeb700 1 -- start start 2020-11-20T12:14:32.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.801+0000 7f7a32aeb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0bf720 0x7f7a2c14d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.801+0000 7f7a32aeb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c0c2070 0x7f7a2c112030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.801+0000 7f7a32aeb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c151bc0 0x7f7a2c112520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.801+0000 7f7a32aeb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c153280 con 0x7f7a2c0bf720 2020-11-20T12:14:32.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.801+0000 7f7a32aeb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1603d0 con 0x7f7a2c0c2070 2020-11-20T12:14:32.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.801+0000 7f7a32aeb700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c160670 con 0x7f7a2c151bc0 2020-11-20T12:14:32.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0bf720 0x7f7a2c14d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a312e8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c0c2070 0x7f7a2c112030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0bf720 0x7f7a2c14d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60944/0 (socket says 172.21.15.160:60944) 2020-11-20T12:14:32.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 -- 172.21.15.160:0/2026977750 learned_addr learned my addr 172.21.15.160:0/2026977750 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:32.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a322ea700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c151bc0 0x7f7a2c112520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 -- 172.21.15.160:0/2026977750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c151bc0 msgr2=0x7f7a2c112520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c151bc0 0x7f7a2c112520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 -- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c0c2070 msgr2=0x7f7a2c112030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c0c2070 0x7f7a2c112030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 -- 172.21.15.160:0/2026977750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c160910 con 0x7f7a2c0bf720 2020-11-20T12:14:32.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a312e8700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c0c2070 0x7f7a2c112030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:32.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.802+0000 7f7a31ae9700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0bf720 0x7f7a2c14d380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f7a2800c710 tx=0x7f7a28007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.803+0000 7f7a19ffb700 1 -- 172.21.15.160:0/2026977750 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a280072e0 con 0x7f7a2c0bf720 2020-11-20T12:14:32.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.803+0000 7f7a19ffb700 1 -- 172.21.15.160:0/2026977750 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28007440 con 0x7f7a2c0bf720 2020-11-20T12:14:32.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.803+0000 7f7a19ffb700 1 -- 172.21.15.160:0/2026977750 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a28005800 con 0x7f7a2c0bf720 2020-11-20T12:14:32.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.803+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c160bb0 con 0x7f7a2c0bf720 2020-11-20T12:14:32.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.803+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c15fff0 con 0x7f7a2c0bf720 2020-11-20T12:14:32.813 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.804+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c0611e0 con 0x7f7a2c0bf720 2020-11-20T12:14:32.814 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.805+0000 7f7a19ffb700 1 -- 172.21.15.160:0/2026977750 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7a28010070 con 0x7f7a2c0bf720 2020-11-20T12:14:32.814 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.806+0000 7f7a19ffb700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7a04080630 0x7f7a04082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.807+0000 7f7a19ffb700 1 -- 172.21.15.160:0/2026977750 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f7a280a20f0 con 0x7f7a2c0bf720 2020-11-20T12:14:32.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.807+0000 7f7a312e8700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7a04080630 0x7f7a04082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.807+0000 7f7a312e8700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7a04080630 0x7f7a04082af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f7a1c00b9d0 tx=0x7f7a1c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.808+0000 7f7a19ffb700 1 -- 172.21.15.160:0/2026977750 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7a28076c70 con 0x7f7a2c0bf720 2020-11-20T12:14:32.995 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.991+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a2c044f60 con 0x7f7a2c0bf720 2020-11-20T12:14:32.995 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.992+0000 7f7a19ffb700 1 -- 172.21.15.160:0/2026977750 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7a2807a290 con 0x7f7a2c0bf720 2020-11-20T12:14:32.996 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:32.997 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7a04080630 msgr2=0x7f7a04082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7a04080630 0x7f7a04082af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f7a1c00b9d0 tx=0x7f7a1c015000).stop 2020-11-20T12:14:32.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0bf720 msgr2=0x7f7a2c14d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0bf720 0x7f7a2c14d380 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f7a2800c710 tx=0x7f7a28007ad0).stop 2020-11-20T12:14:32.998 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 shutdown_connections 2020-11-20T12:14:32.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7a04080630 0x7f7a04082af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a2c151bc0 0x7f7a2c112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0bf720 0x7f7a2c14d380 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.999 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 --2- 172.21.15.160:0/2026977750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7a2c0c2070 0x7f7a2c112030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 >> 172.21.15.160:0/2026977750 conn(0x7f7a2c060140 msgr2=0x7f7a2c05ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 shutdown_connections 2020-11-20T12:14:33.000 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:32.994+0000 7f7a32aeb700 1 -- 172.21.15.160:0/2026977750 wait complete. 2020-11-20T12:14:33.021 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T12:14:33.252 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.248+0000 7f171ede9700 1 Processor -- start 2020-11-20T12:14:33.252 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.248+0000 7f171ede9700 1 -- start start 2020-11-20T12:14:33.256 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171ede9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f171814e7f0 0x7f17180bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.256 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171ede9700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1718063d10 con 0x7f1718067190 2020-11-20T12:14:33.257 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171ede9700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17181519a0 con 0x7f17180bc620 2020-11-20T12:14:33.257 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171ede9700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1718151c40 con 0x7f171814e7f0 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171d5e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f171814e7f0 0x7f17180bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171d5e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f171814e7f0 0x7f17180bca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51568/0 (socket says 172.21.15.160:51568) 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171d5e6700 1 -- 172.21.15.160:0/597859778 learned_addr learned my addr 172.21.15.160:0/597859778 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:33.259 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.250+0000 7f171e5e8700 1 --1- 172.21.15.160:0/597859778 >> v1:172.21.15.134:6789/0 conn(0x7f1718067190 0x7f171814efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60742/0 (socket says 172.21.15.160:60742) 2020-11-20T12:14:33.259 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.251+0000 7f171d5e6700 1 -- 172.21.15.160:0/597859778 >> v1:172.21.15.150:6789/0 conn(0x7f17180bc620 legacy=0x7f17181510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.260 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.251+0000 7f171d5e6700 1 -- 172.21.15.160:0/597859778 >> v1:172.21.15.134:6789/0 conn(0x7f1718067190 legacy=0x7f171814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.260 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.251+0000 7f171d5e6700 1 -- 172.21.15.160:0/597859778 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718151ee0 con 0x7f171814e7f0 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.251+0000 7f171d5e6700 1 --2- 172.21.15.160:0/597859778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171814e7f0 0x7f17180bca00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1718064a50 tx=0x7f1708006eb0).ready entity=mon.1 client_cookie=9fa9beca03b5355b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.251+0000 7f171cde5700 1 -- 172.21.15.160:0/597859778 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708009960 con 0x7f171814e7f0 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.251+0000 7f171cde5700 1 -- 172.21.15.160:0/597859778 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1708009ac0 con 0x7f171814e7f0 2020-11-20T12:14:33.262 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.251+0000 7f171cde5700 1 -- 172.21.15.160:0/597859778 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1708009e40 con 0x7f171814e7f0 2020-11-20T12:14:33.262 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.252+0000 7f171ede9700 1 -- 172.21.15.160:0/597859778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171814e7f0 msgr2=0x7f17180bca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.263 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.252+0000 7f171ede9700 1 --2- 172.21.15.160:0/597859778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171814e7f0 0x7f17180bca00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f1718064a50 tx=0x7f1708006eb0).stop 2020-11-20T12:14:33.263 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.252+0000 7f171ede9700 1 -- 172.21.15.160:0/597859778 shutdown_connections 2020-11-20T12:14:33.263 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.252+0000 7f171ede9700 1 --2- 172.21.15.160:0/597859778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f171814e7f0 0x7f17180bca00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.263 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.252+0000 7f171ede9700 1 -- 172.21.15.160:0/597859778 >> 172.21.15.160:0/597859778 conn(0x7f1718062ef0 msgr2=0x7f1718063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.264 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.252+0000 7f171ede9700 1 -- 172.21.15.160:0/597859778 shutdown_connections 2020-11-20T12:14:33.264 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.252+0000 7f171ede9700 1 -- 172.21.15.160:0/597859778 wait complete. 2020-11-20T12:14:33.266 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.253+0000 7f171ede9700 1 Processor -- start 2020-11-20T12:14:33.267 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.254+0000 7f171ede9700 1 -- start start 2020-11-20T12:14:33.267 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.254+0000 7f171ede9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1718067190 0x7f1718065520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.267 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.254+0000 7f171ede9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180bc620 0x7f1718141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.267 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.254+0000 7f171ede9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171814e7f0 0x7f1718141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.268 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.254+0000 7f171ede9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1718141f70 con 0x7f17180bc620 2020-11-20T12:14:33.268 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.254+0000 7f171ede9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1718155560 con 0x7f1718067190 2020-11-20T12:14:33.268 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.254+0000 7f171ede9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1718155800 con 0x7f171814e7f0 2020-11-20T12:14:33.268 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180bc620 0x7f1718141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.268 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171dde7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1718067190 0x7f1718065520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.269 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180bc620 0x7f1718141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:60958/0 (socket says 172.21.15.160:60958) 2020-11-20T12:14:33.269 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 -- 172.21.15.160:0/3065609617 learned_addr learned my addr 172.21.15.160:0/3065609617 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:33.269 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171e5e8700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171814e7f0 0x7f1718141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.269 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 -- 172.21.15.160:0/3065609617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171814e7f0 msgr2=0x7f1718141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.270 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171814e7f0 0x7f1718141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.270 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 -- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1718067190 msgr2=0x7f1718065520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.270 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1718067190 0x7f1718065520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.270 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171d5e6700 1 -- 172.21.15.160:0/3065609617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718155aa0 con 0x7f17180bc620 2020-11-20T12:14:33.270 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.255+0000 7f171e5e8700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171814e7f0 0x7f1718141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:33.271 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.256+0000 7f171d5e6700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180bc620 0x7f1718141590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f1708006fd0 tx=0x7f1708015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.271 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.256+0000 7f1705ffb700 1 -- 172.21.15.160:0/3065609617 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170801e460 con 0x7f17180bc620 2020-11-20T12:14:33.271 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.256+0000 7f1705ffb700 1 -- 172.21.15.160:0/3065609617 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170801e5c0 con 0x7f17180bc620 2020-11-20T12:14:33.271 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.256+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1718155d40 con 0x7f17180bc620 2020-11-20T12:14:33.271 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.256+0000 7f1705ffb700 1 -- 172.21.15.160:0/3065609617 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170801e960 con 0x7f17180bc620 2020-11-20T12:14:33.272 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.256+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17181454d0 con 0x7f17180bc620 2020-11-20T12:14:33.272 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.257+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1718156380 con 0x7f17180bc620 2020-11-20T12:14:33.272 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.259+0000 7f1705ffb700 1 -- 172.21.15.160:0/3065609617 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1708025030 con 0x7f17180bc620 2020-11-20T12:14:33.272 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.259+0000 7f1705ffb700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f16f0080630 0x7f16f0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.272 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.260+0000 7f1705ffb700 1 -- 172.21.15.160:0/3065609617 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f17080a4480 con 0x7f17180bc620 2020-11-20T12:14:33.273 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.260+0000 7f171dde7700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f16f0080630 0x7f16f0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.273 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.260+0000 7f171dde7700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f16f0080630 0x7f16f0082af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f17140035f0 tx=0x7f1714007b90).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.273 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.262+0000 7f1705ffb700 1 -- 172.21.15.160:0/3065609617 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1708078f70 con 0x7f17180bc620 2020-11-20T12:14:33.511 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.507+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1718156380 con 0x7f17180bc620 2020-11-20T12:14:33.511 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.508+0000 7f1705ffb700 1 -- 172.21.15.160:0/3065609617 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f1718156380 con 0x7f17180bc620 2020-11-20T12:14:33.512 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:33.512 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/70698057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":70698057},{"type":"v1","addr":"172.21.15.150:6835","nonce":70698057}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4305,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1085571547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1085571547},{"type":"v1","addr":"172.21.15.134:6833","nonce":1085571547}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T12:14:10.878025+0000","modified":"2020-11-20T12:14:14.341505+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6833/2973718049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2973718049},{"type":"v1","addr":"172.21.15.160:6833","nonce":2973718049}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T12:14:33.515 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f16f0080630 msgr2=0x7f16f0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.515 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f16f0080630 0x7f16f0082af0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f17140035f0 tx=0x7f1714007b90).stop 2020-11-20T12:14:33.515 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180bc620 msgr2=0x7f1718141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.515 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180bc620 0x7f1718141590 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f1708006fd0 tx=0x7f1708015000).stop 2020-11-20T12:14:33.516 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 shutdown_connections 2020-11-20T12:14:33.516 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f16f0080630 0x7f16f0082af0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.516 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f171814e7f0 0x7f1718141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.516 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1718067190 0x7f1718065520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.516 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 --2- 172.21.15.160:0/3065609617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17180bc620 0x7f1718141590 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.517 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 >> 172.21.15.160:0/3065609617 conn(0x7f1718062ef0 msgr2=0x7f1718145d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.517 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 shutdown_connections 2020-11-20T12:14:33.517 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:33.511+0000 7f171ede9700 1 -- 172.21.15.160:0/3065609617 wait complete. 2020-11-20T12:14:33.517 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 8 2020-11-20T12:14:33.837 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T12:14:10.878025+0000', 'modified': '2020-11-20T12:14:14.341505+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6833/2973718049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 2973718049}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 2973718049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T12:14:33.838 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T12:14:33.838 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T12:14:34.119 INFO:teuthology.orchestra.run.smithi160.stdout:{"cluster_fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","whoami":0,"id":4308,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":23.217525555000002,"mdsmap_epoch":8,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":27.732531668} 2020-11-20T12:14:34.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "9013b66f-4346-4464-9f02-9fb5fd49fe5a", "fs_name": "cephfs", "id": 4308, "mdsmap_epoch": 8, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 23.217525555, "state": "up:active", "uptime": 27.732531668, "want_state": "up:active", "whoami": 0 } 2020-11-20T12:14:34.120 INFO:teuthology.run_tasks:Running task kclient... 2020-11-20T12:14:34.138 INFO:tasks.kclient:Mounting kernel clients... 2020-11-20T12:14:34.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:34.140 INFO:teuthology.orchestra.run.smithi160:> ip netns list 2020-11-20T12:14:34.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:34.197 INFO:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2020-11-20T12:14:34.301 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2020-11-20T12:14:34.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:14:34.306 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2020-11-20T12:14:34.306 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2020-11-20T12:14:34.307 INFO:tasks.cephfs.mount:self.client.name = client.0 2020-11-20T12:14:34.307 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:34.307 INFO:tasks.cephfs.mount:self.cephfs_name = None 2020-11-20T12:14:34.308 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2020-11-20T12:14:34.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2020-11-20T12:14:34.308 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-11-20T12:14:34.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:34.309 INFO:teuthology.orchestra.run.smithi160:> ip addr 2020-11-20T12:14:34.361 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-11-20T12:14:34.362 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-11-20T12:14:34.362 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2020-11-20T12:14:34.362 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2020-11-20T12:14:34.363 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2020-11-20T12:14:34.363 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2020-11-20T12:14:34.363 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T12:14:34.363 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:34.363 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T12:14:34.364 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:34.364 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T12:14:34.364 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:34.364 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-11-20T12:14:34.364 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:34.365 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-11-20T12:14:34.365 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42791sec preferred_lft 42791sec 2020-11-20T12:14:34.365 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2020-11-20T12:14:34.365 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2020-11-20T12:14:34.366 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-11-20T12:14:34.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:34.367 INFO:teuthology.orchestra.run.smithi160:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:34.367 INFO:teuthology.orchestra.run.smithi160:> set -e 2020-11-20T12:14:34.368 INFO:teuthology.orchestra.run.smithi160:> sudo ip link add name ceph-brx type bridge 2020-11-20T12:14:34.368 INFO:teuthology.orchestra.run.smithi160:> sudo ip addr flush dev ceph-brx 2020-11-20T12:14:34.368 INFO:teuthology.orchestra.run.smithi160:> sudo ip link set ceph-brx up 2020-11-20T12:14:34.369 INFO:teuthology.orchestra.run.smithi160:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-11-20T12:14:34.369 INFO:teuthology.orchestra.run.smithi160:> ') 2020-11-20T12:14:34.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:34.973 INFO:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-11-20T12:14:35.073 INFO:teuthology.orchestra.run.smithi160.stdout:1 2020-11-20T12:14:35.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:35.077 INFO:teuthology.orchestra.run.smithi160:> route 2020-11-20T12:14:35.149 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2020-11-20T12:14:35.149 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-11-20T12:14:35.150 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 103 0 0 enp3s0f1 2020-11-20T12:14:35.150 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 103 0 0 enp3s0f1 2020-11-20T12:14:35.150 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-11-20T12:14:35.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:35.152 INFO:teuthology.orchestra.run.smithi160:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:35.152 INFO:teuthology.orchestra.run.smithi160:> set -e 2020-11-20T12:14:35.152 INFO:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2020-11-20T12:14:35.153 INFO:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2020-11-20T12:14:35.153 INFO:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2020-11-20T12:14:35.153 INFO:teuthology.orchestra.run.smithi160:> ') 2020-11-20T12:14:36.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:36.082 INFO:teuthology.orchestra.run.smithi160:> ip netns list 2020-11-20T12:14:36.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:36.143 INFO:teuthology.orchestra.run.smithi160:> ip netns list-id 2020-11-20T12:14:36.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:36.208 INFO:teuthology.orchestra.run.smithi160:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:36.209 INFO:teuthology.orchestra.run.smithi160:> set -e 2020-11-20T12:14:36.209 INFO:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T12:14:36.209 INFO:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2020-11-20T12:14:36.210 INFO:teuthology.orchestra.run.smithi160:> ') 2020-11-20T12:14:36.426 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-11-20T12:14:36.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:36.427 INFO:teuthology.orchestra.run.smithi160:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:36.428 INFO:teuthology.orchestra.run.smithi160:> set -e 2020-11-20T12:14:36.428 INFO:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2020-11-20T12:14:36.428 INFO:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2020-11-20T12:14:36.429 INFO:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2020-11-20T12:14:36.429 INFO:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2020-11-20T12:14:36.429 INFO:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2020-11-20T12:14:36.430 INFO:teuthology.orchestra.run.smithi160:> ') 2020-11-20T12:14:36.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:36.841 INFO:teuthology.orchestra.run.smithi160:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:36.841 INFO:teuthology.orchestra.run.smithi160:> set -e 2020-11-20T12:14:36.842 INFO:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2020-11-20T12:14:36.842 INFO:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.0 master ceph-brx 2020-11-20T12:14:36.842 INFO:teuthology.orchestra.run.smithi160:> ') 2020-11-20T12:14:37.078 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:37.314 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.311+0000 7f7893fff700 1 Processor -- start 2020-11-20T12:14:37.315 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.311+0000 7f7893fff700 1 -- start start 2020-11-20T12:14:37.316 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f7893fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f789414e7f0 0x7f78940bca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.316 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f7893fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7894067190 0x7f789414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.317 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f7893fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7894063d10 con 0x7f78940bc620 2020-11-20T12:14:37.317 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f7893fff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78941519a0 con 0x7f789414e7f0 2020-11-20T12:14:37.317 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f7893fff700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7894151c40 con 0x7f7894067190 2020-11-20T12:14:37.318 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f78937fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f7894067190 0x7f789414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.318 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f7892ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f78940bc620 0x7f78941510d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47288/0 (socket says 172.21.15.160:47288) 2020-11-20T12:14:37.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.313+0000 7f7892ffd700 1 -- 172.21.15.160:0/425428624 learned_addr learned my addr 172.21.15.160:0/425428624 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:37.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f788bfff700 1 --2- 172.21.15.160:0/425428624 >> v2:172.21.15.134:3300/0 conn(0x7f789414e7f0 0x7f78940bca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f78927fc700 1 -- 172.21.15.160:0/425428624 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754846249 0 0) 0x7f7894063d10 con 0x7f78940bc620 2020-11-20T12:14:37.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f78927fc700 1 -- 172.21.15.160:0/425428624 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7874003240 con 0x7f78940bc620 2020-11-20T12:14:37.319 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f78937fe700 1 -- 172.21.15.160:0/425428624 >> v2:172.21.15.134:3300/0 conn(0x7f789414e7f0 msgr2=0x7f78940bca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:37.320 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f78937fe700 1 --2- 172.21.15.160:0/425428624 >> v2:172.21.15.134:3300/0 conn(0x7f789414e7f0 0x7f78940bca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.320 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f78927fc700 1 -- 172.21.15.160:0/425428624 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2725804771 0 0) 0x7f7874003240 con 0x7f78940bc620 2020-11-20T12:14:37.320 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f78937fe700 1 -- 172.21.15.160:0/425428624 >> v1:172.21.15.150:6789/0 conn(0x7f78940bc620 legacy=0x7f78941510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.320 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.314+0000 7f78937fe700 1 -- 172.21.15.160:0/425428624 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894151ee0 con 0x7f7894067190 2020-11-20T12:14:37.321 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.315+0000 7f78937fe700 1 --2- 172.21.15.160:0/425428624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7894067190 0x7f789414efd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f78940685d0 tx=0x7f788c0091d0).ready entity=mon.2 client_cookie=4141847263b7e87c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.321 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.315+0000 7f78927fc700 1 -- 172.21.15.160:0/425428624 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840014e0 con 0x7f7894067190 2020-11-20T12:14:37.321 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.315+0000 7f78927fc700 1 -- 172.21.15.160:0/425428624 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c00b7c0 con 0x7f7894067190 2020-11-20T12:14:37.321 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.315+0000 7f78927fc700 1 -- 172.21.15.160:0/425428624 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00bb40 con 0x7f7894067190 2020-11-20T12:14:37.323 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.315+0000 7f7893fff700 1 -- 172.21.15.160:0/425428624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7894067190 msgr2=0x7f789414efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.323 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.315+0000 7f7893fff700 1 --2- 172.21.15.160:0/425428624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7894067190 0x7f789414efd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f78940685d0 tx=0x7f788c0091d0).stop 2020-11-20T12:14:37.323 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.316+0000 7f7893fff700 1 -- 172.21.15.160:0/425428624 shutdown_connections 2020-11-20T12:14:37.323 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.316+0000 7f7893fff700 1 --2- 172.21.15.160:0/425428624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7894067190 0x7f789414efd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.316+0000 7f7893fff700 1 --2- 172.21.15.160:0/425428624 >> v2:172.21.15.134:3300/0 conn(0x7f789414e7f0 0x7f78940bca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.316+0000 7f7893fff700 1 -- 172.21.15.160:0/425428624 >> 172.21.15.160:0/425428624 conn(0x7f7894062ef0 msgr2=0x7f7894063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:37.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.316+0000 7f7893fff700 1 -- 172.21.15.160:0/425428624 shutdown_connections 2020-11-20T12:14:37.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.316+0000 7f7893fff700 1 -- 172.21.15.160:0/425428624 wait complete. 2020-11-20T12:14:37.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.317+0000 7f7893fff700 1 Processor -- start 2020-11-20T12:14:37.325 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.318+0000 7f7893fff700 1 -- start start 2020-11-20T12:14:37.325 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.318+0000 7f7893fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7894067190 0x7f789414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.325 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.318+0000 7f7893fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78940bc620 0x7f78940c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.325 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.318+0000 7f7893fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f789414e7f0 0x7f78940c2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.326 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.318+0000 7f7893fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894065a00 con 0x7f78940bc620 2020-11-20T12:14:37.326 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.318+0000 7f7893fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789413dde0 con 0x7f7894067190 2020-11-20T12:14:37.326 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.318+0000 7f7893fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894064f80 con 0x7f789414e7f0 2020-11-20T12:14:37.326 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f78937fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f789414e7f0 0x7f78940c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f7892ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7894067190 0x7f789414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f78937fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f789414e7f0 0x7f78940c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38452/0 (socket says 172.21.15.160:38452) 2020-11-20T12:14:37.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f78937fe700 1 -- 172.21.15.160:0/1568700376 learned_addr learned my addr 172.21.15.160:0/1568700376 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:37.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f788bfff700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78940bc620 0x7f78940c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f78937fe700 1 -- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7894067190 msgr2=0x7f789414d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f78937fe700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7894067190 0x7f789414d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f78937fe700 1 -- 172.21.15.160:0/1568700376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78940bc620 msgr2=0x7f78940c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.319+0000 7f78937fe700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78940bc620 0x7f78940c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f78937fe700 1 -- 172.21.15.160:0/1568700376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894065220 con 0x7f789414e7f0 2020-11-20T12:14:37.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f7892ffd700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7894067190 0x7f789414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:37.330 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f78937fe700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f789414e7f0 0x7f78940c2480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f788c011b90 tx=0x7f788c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.330 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f788affd700 1 -- 172.21.15.160:0/1568700376 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c01d660 con 0x7f789414e7f0 2020-11-20T12:14:37.330 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f788affd700 1 -- 172.21.15.160:0/1568700376 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c01d7c0 con 0x7f789414e7f0 2020-11-20T12:14:37.331 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78940654c0 con 0x7f789414e7f0 2020-11-20T12:14:37.331 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f788affd700 1 -- 172.21.15.160:0/1568700376 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c01db60 con 0x7f789414e7f0 2020-11-20T12:14:37.331 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.320+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7894147220 con 0x7f789414e7f0 2020-11-20T12:14:37.331 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.321+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78941473e0 con 0x7f789414e7f0 2020-11-20T12:14:37.331 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.322+0000 7f788affd700 1 -- 172.21.15.160:0/1568700376 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f788c017040 con 0x7f789414e7f0 2020-11-20T12:14:37.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.323+0000 7f788affd700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7870080660 0x7f7870082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.324+0000 7f788affd700 1 -- 172.21.15.160:0/1568700376 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f788c0a4ca0 con 0x7f789414e7f0 2020-11-20T12:14:37.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.324+0000 7f7892ffd700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7870080660 0x7f7870082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.324+0000 7f7892ffd700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7870080660 0x7f7870082b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7884001750 tx=0x7f78840011f0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.327+0000 7f788affd700 1 -- 172.21.15.160:0/1568700376 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f788c0797d0 con 0x7f789414e7f0 2020-11-20T12:14:37.519 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.516+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7894044f60 con 0x7f789414e7f0 2020-11-20T12:14:37.522 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.519+0000 7f788affd700 1 -- 172.21.15.160:0/1568700376 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7f788c015020 con 0x7f789414e7f0 2020-11-20T12:14:37.523 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:37.523 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:37.524 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.521+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7870080660 msgr2=0x7f7870082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.526 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.521+0000 7f7893fff700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7870080660 0x7f7870082b20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7884001750 tx=0x7f78840011f0).stop 2020-11-20T12:14:37.526 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f789414e7f0 msgr2=0x7f78940c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.526 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f789414e7f0 0x7f78940c2480 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f788c011b90 tx=0x7f788c016000).stop 2020-11-20T12:14:37.526 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 shutdown_connections 2020-11-20T12:14:37.527 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f7870080660 0x7f7870082b20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.527 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f789414e7f0 0x7f78940c2480 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.527 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7894067190 0x7f789414d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.527 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 --2- 172.21.15.160:0/1568700376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f78940bc620 0x7f78940c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.527 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 >> 172.21.15.160:0/1568700376 conn(0x7f7894062ef0 msgr2=0x7f7894149bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:37.528 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 shutdown_connections 2020-11-20T12:14:37.528 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.522+0000 7f7893fff700 1 -- 172.21.15.160:0/1568700376 wait complete. 2020-11-20T12:14:37.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:13:54.112655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:04.811782+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T12:14:08.565233+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T12:14:09.890329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T12:14:37.551 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:37.803 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.800+0000 7f6760e3f700 1 Processor -- start 2020-11-20T12:14:37.803 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.800+0000 7f6760e3f700 1 -- start start 2020-11-20T12:14:37.804 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.801+0000 7f6760e3f700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f675c0bfb50 0x7f675c0bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.801+0000 7f6760e3f700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f675c0b9f90 0x7f675c0bd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.801+0000 7f6760e3f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f675c0bf3d0 con 0x7f675c14e5d0 2020-11-20T12:14:37.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.801+0000 7f6760e3f700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c0bad90 con 0x7f675c0bfb50 2020-11-20T12:14:37.805 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.801+0000 7f6760e3f700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f675c14da00 con 0x7f675c0b9f90 2020-11-20T12:14:37.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675b7fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f675c0bfb50 0x7f675c0bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f6752ffd700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f675c14e5d0 0x7f675c0bcd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60768/0 (socket says 172.21.15.160:60768) 2020-11-20T12:14:37.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f6752ffd700 1 -- 172.21.15.160:0/1477834888 learned_addr learned my addr 172.21.15.160:0/1477834888 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:37.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675bfff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f675c0b9f90 0x7f675c0bd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.808 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675b7fe700 1 -- 172.21.15.160:0/1477834888 >> v2:172.21.15.160:3300/0 conn(0x7f675c0b9f90 msgr2=0x7f675c0bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:37.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675affd700 1 -- 172.21.15.160:0/1477834888 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404725079 0 0) 0x7f675c0bf3d0 con 0x7f675c14e5d0 2020-11-20T12:14:37.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675b7fe700 1 --2- 172.21.15.160:0/1477834888 >> v2:172.21.15.160:3300/0 conn(0x7f675c0b9f90 0x7f675c0bd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675b7fe700 1 -- 172.21.15.160:0/1477834888 >> v1:172.21.15.134:6789/0 conn(0x7f675c14e5d0 legacy=0x7f675c0bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.809 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675b7fe700 1 -- 172.21.15.160:0/1477834888 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0ba850 con 0x7f675c0bfb50 2020-11-20T12:14:37.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.802+0000 7f675b7fe700 1 --2- 172.21.15.160:0/1477834888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c0bfb50 0x7f675c0bff30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f675c0c05e0 tx=0x7f674c006df0).ready entity=mon.1 client_cookie=21314964d0ce49e5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f675affd700 1 -- 172.21.15.160:0/1477834888 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c0097b0 con 0x7f675c0bfb50 2020-11-20T12:14:37.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f675affd700 1 -- 172.21.15.160:0/1477834888 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c009910 con 0x7f675c0bfb50 2020-11-20T12:14:37.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f675affd700 1 -- 172.21.15.160:0/1477834888 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c009c90 con 0x7f675c0bfb50 2020-11-20T12:14:37.810 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 -- 172.21.15.160:0/1477834888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c0bfb50 msgr2=0x7f675c0bff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 --2- 172.21.15.160:0/1477834888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c0bfb50 0x7f675c0bff30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f675c0c05e0 tx=0x7f674c006df0).stop 2020-11-20T12:14:37.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 -- 172.21.15.160:0/1477834888 shutdown_connections 2020-11-20T12:14:37.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 --2- 172.21.15.160:0/1477834888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c0bfb50 0x7f675c0bff30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.811 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 --2- 172.21.15.160:0/1477834888 >> v2:172.21.15.160:3300/0 conn(0x7f675c0b9f90 0x7f675c0bd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 -- 172.21.15.160:0/1477834888 >> 172.21.15.160:0/1477834888 conn(0x7f675c060140 msgr2=0x7f675c060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:37.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 -- 172.21.15.160:0/1477834888 shutdown_connections 2020-11-20T12:14:37.812 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.803+0000 7f6760e3f700 1 -- 172.21.15.160:0/1477834888 wait complete. 2020-11-20T12:14:37.814 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.805+0000 7f6760e3f700 1 Processor -- start 2020-11-20T12:14:37.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.805+0000 7f6760e3f700 1 -- start start 2020-11-20T12:14:37.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.806+0000 7f6760e3f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f675c0b9f90 0x7f675c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.806+0000 7f6760e3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c0bfb50 0x7f675c160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.815 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.806+0000 7f6760e3f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c14e5d0 0x7f675c14b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.806+0000 7f6760e3f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c160fc0 con 0x7f675c0bfb50 2020-11-20T12:14:37.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.806+0000 7f6760e3f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c14ce40 con 0x7f675c14e5d0 2020-11-20T12:14:37.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.806+0000 7f6760e3f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675c14d0e0 con 0x7f675c0b9f90 2020-11-20T12:14:37.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.806+0000 7f675b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f675c0b9f90 0x7f675c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.816 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f675b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f675c0b9f90 0x7f675c151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38464/0 (socket says 172.21.15.160:38464) 2020-11-20T12:14:37.817 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f675b7fe700 1 -- 172.21.15.160:0/782158671 learned_addr learned my addr 172.21.15.160:0/782158671 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:37.817 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f6752ffd700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c0bfb50 0x7f675c160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.817 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f675bfff700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c14e5d0 0x7f675c14b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.817 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f6752ffd700 1 -- 172.21.15.160:0/782158671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f675c0b9f90 msgr2=0x7f675c151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.818 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f6752ffd700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f675c0b9f90 0x7f675c151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.818 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f6752ffd700 1 -- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c14e5d0 msgr2=0x7f675c14b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.818 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f6752ffd700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c14e5d0 0x7f675c14b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.818 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f6752ffd700 1 -- 172.21.15.160:0/782158671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c14d380 con 0x7f675c0bfb50 2020-11-20T12:14:37.818 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f675bfff700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c14e5d0 0x7f675c14b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:37.819 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f675b7fe700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f675c0b9f90 0x7f675c151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:37.819 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.807+0000 7f6752ffd700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c0bfb50 0x7f675c160ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f675c14ea30 tx=0x7f6744007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.819 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.808+0000 7f6753fff700 1 -- 172.21.15.160:0/782158671 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67440072e0 con 0x7f675c0bfb50 2020-11-20T12:14:37.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.808+0000 7f6753fff700 1 -- 172.21.15.160:0/782158671 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6744007440 con 0x7f675c0bfb50 2020-11-20T12:14:37.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.808+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f675c14a910 con 0x7f675c0bfb50 2020-11-20T12:14:37.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.808+0000 7f6753fff700 1 -- 172.21.15.160:0/782158671 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6744005840 con 0x7f675c0bfb50 2020-11-20T12:14:37.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.808+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f675c144a30 con 0x7f675c0bfb50 2020-11-20T12:14:37.820 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.809+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675c14a770 con 0x7f675c0bfb50 2020-11-20T12:14:37.821 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.810+0000 7f6753fff700 1 -- 172.21.15.160:0/782158671 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6744010070 con 0x7f675c0bfb50 2020-11-20T12:14:37.821 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.811+0000 7f6753fff700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6738080630 0x7f6738082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.821 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.811+0000 7f6753fff700 1 -- 172.21.15.160:0/782158671 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f67440a1eb0 con 0x7f675c0bfb50 2020-11-20T12:14:37.822 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.811+0000 7f675b7fe700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6738080630 0x7f6738082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.822 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.812+0000 7f675b7fe700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6738080630 0x7f6738082af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f674c00c010 tx=0x7f674c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.823 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:37.814+0000 7f6753fff700 1 -- 172.21.15.160:0/782158671 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6744076a30 con 0x7f675c0bfb50 2020-11-20T12:14:38.005 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.001+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f675c14a770 con 0x7f675c0bfb50 2020-11-20T12:14:38.006 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.002+0000 7f6753fff700 1 -- 172.21.15.160:0/782158671 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v26) v1 ==== 110+0+10 (secure 0 0 0) 0x7f675c14a770 con 0x7f675c0bfb50 2020-11-20T12:14:38.006 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 1 2020-11-20T12:14:38.008 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6738080630 msgr2=0x7f6738082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.008 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6738080630 0x7f6738082af0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f674c00c010 tx=0x7f674c015000).stop 2020-11-20T12:14:38.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c0bfb50 msgr2=0x7f675c160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c0bfb50 0x7f675c160ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f675c14ea30 tx=0x7f6744007c00).stop 2020-11-20T12:14:38.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 shutdown_connections 2020-11-20T12:14:38.009 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6738080630 0x7f6738082af0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f675c14e5d0 0x7f675c14b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f675c0b9f90 0x7f675c151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 --2- 172.21.15.160:0/782158671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f675c0bfb50 0x7f675c160ad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.004+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 >> 172.21.15.160:0/782158671 conn(0x7f675c060140 msgr2=0x7f675c146e00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:38.010 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.005+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 shutdown_connections 2020-11-20T12:14:38.011 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.005+0000 7f6760e3f700 1 -- 172.21.15.160:0/782158671 wait complete. 2020-11-20T12:14:38.032 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:38.275 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.272+0000 7f933986f700 1 Processor -- start 2020-11-20T12:14:38.275 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.272+0000 7f933986f700 1 -- start start 2020-11-20T12:14:38.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.273+0000 7f933986f700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93340bf3d0 con 0x7f93340bff30 2020-11-20T12:14:38.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f933986f700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93340ba850 con 0x7f93340bfb50 2020-11-20T12:14:38.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f933986f700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93340baaf0 con 0x7f933414e5d0 2020-11-20T12:14:38.277 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f933886d700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f93340bfb50 0x7f93340bcd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47316/0 (socket says 172.21.15.160:47316) 2020-11-20T12:14:38.278 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f933886d700 1 -- 172.21.15.160:0/1569885756 learned_addr learned my addr 172.21.15.160:0/1569885756 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:38.279 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011290647 0 0) 0x7f93340ba850 con 0x7f93340bfb50 2020-11-20T12:14:38.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9320003240 con 0x7f93340bfb50 2020-11-20T12:14:38.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303505578 0 0) 0x7f93340bf3d0 con 0x7f93340bff30 2020-11-20T12:14:38.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.274+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93340ba850 con 0x7f93340bff30 2020-11-20T12:14:38.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475738951 0 0) 0x7f93340baaf0 con 0x7f933414e5d0 2020-11-20T12:14:38.280 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93340bf3d0 con 0x7f933414e5d0 2020-11-20T12:14:38.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3429233046 0 0) 0x7f9320003240 con 0x7f93340bfb50 2020-11-20T12:14:38.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 >> v1:172.21.15.160:6789/0 conn(0x7f933414e5d0 legacy=0x7f93340b9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 >> v1:172.21.15.134:6789/0 conn(0x7f93340bff30 legacy=0x7f93340bd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933414dbf0 con 0x7f93340bfb50 2020-11-20T12:14:38.281 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f9330001860 con 0x7f93340bfb50 2020-11-20T12:14:38.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 >> v1:172.21.15.150:6789/0 conn(0x7f93340bfb50 legacy=0x7f93340bcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9320003b70 0x7f9320003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200045d0 0x7f9320004a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9320005030 0x7f932000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.282 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932000bd40 con 0x7f93200045d0 2020-11-20T12:14:38.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932000beb0 con 0x7f9320005030 2020-11-20T12:14:38.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932000e280 con 0x7f9320003b70 2020-11-20T12:14:38.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f932bfff700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200045d0 0x7f9320004a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f933886d700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9320003b70 0x7f9320003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.283 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.275+0000 7f933906e700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9320005030 0x7f932000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932bfff700 1 -- 172.21.15.160:0/1569885756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9320003b70 msgr2=0x7f9320003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:38.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932bfff700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9320003b70 0x7f9320003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932bfff700 1 -- 172.21.15.160:0/1569885756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9320005030 msgr2=0x7f932000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:38.284 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932bfff700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9320005030 0x7f932000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932bfff700 1 -- 172.21.15.160:0/1569885756 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320003240 con 0x7f93200045d0 2020-11-20T12:14:38.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f933906e700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9320005030 0x7f932000b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:38.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f933906e700 1 -- 172.21.15.160:0/1569885756 reap_dead start 2020-11-20T12:14:38.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932bfff700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200045d0 0x7f9320004a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f93240019f0 tx=0x7f9324007b10).ready entity=mon.0 client_cookie=aa872b377632a0a7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.285 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324007020 con 0x7f93200045d0 2020-11-20T12:14:38.286 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9324007180 con 0x7f93200045d0 2020-11-20T12:14:38.286 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.276+0000 7f932b7fe700 1 -- 172.21.15.160:0/1569885756 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932400c830 con 0x7f93200045d0 2020-11-20T12:14:38.288 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.277+0000 7f933986f700 1 -- 172.21.15.160:0/1569885756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200045d0 msgr2=0x7f9320004a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.288 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.277+0000 7f933986f700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200045d0 0x7f9320004a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f93240019f0 tx=0x7f9324007b10).stop 2020-11-20T12:14:38.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.277+0000 7f933986f700 1 -- 172.21.15.160:0/1569885756 shutdown_connections 2020-11-20T12:14:38.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.277+0000 7f933986f700 1 --2- 172.21.15.160:0/1569885756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200045d0 0x7f9320004a50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.277+0000 7f933986f700 1 -- 172.21.15.160:0/1569885756 >> 172.21.15.160:0/1569885756 conn(0x7f9334060140 msgr2=0x7f9334060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:38.289 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.277+0000 7f933986f700 1 -- 172.21.15.160:0/1569885756 shutdown_connections 2020-11-20T12:14:38.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.277+0000 7f933986f700 1 -- 172.21.15.160:0/1569885756 wait complete. 2020-11-20T12:14:38.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.279+0000 7f933986f700 1 Processor -- start 2020-11-20T12:14:38.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.279+0000 7f933986f700 1 -- start start 2020-11-20T12:14:38.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.280+0000 7f933986f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93200045d0 0x7f933415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.290 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.280+0000 7f933986f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f933414d540 0x7f9334144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.280+0000 7f933986f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9334138920 0x7f9334138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.280+0000 7f933986f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933414a790 con 0x7f933414d540 2020-11-20T12:14:38.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.280+0000 7f933986f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933415c310 con 0x7f93200045d0 2020-11-20T12:14:38.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.280+0000 7f933986f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933414d200 con 0x7f9334138920 2020-11-20T12:14:38.291 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9334138920 0x7f9334138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9334138920 0x7f9334138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38488/0 (socket says 172.21.15.160:38488) 2020-11-20T12:14:38.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 -- 172.21.15.160:0/2601247557 learned_addr learned my addr 172.21.15.160:0/2601247557 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:38.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f932bfff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f933414d540 0x7f9334144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933886d700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93200045d0 0x7f933415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.292 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 -- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93200045d0 msgr2=0x7f933415cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93200045d0 0x7f933415cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 -- 172.21.15.160:0/2601247557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f933414d540 msgr2=0x7f9334144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f933414d540 0x7f9334144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.293 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 -- 172.21.15.160:0/2601247557 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933414a9c0 con 0x7f9334138920 2020-11-20T12:14:38.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.281+0000 7f933906e700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9334138920 0x7f9334138d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f932c0010a0 tx=0x7f932c009040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.282+0000 7f9328ff9700 1 -- 172.21.15.160:0/2601247557 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c00eea0 con 0x7f9334138920 2020-11-20T12:14:38.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.282+0000 7f9328ff9700 1 -- 172.21.15.160:0/2601247557 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c001560 con 0x7f9334138920 2020-11-20T12:14:38.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.282+0000 7f9328ff9700 1 -- 172.21.15.160:0/2601247557 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0018e0 con 0x7f9334138920 2020-11-20T12:14:38.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.282+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933414ac60 con 0x7f9334138920 2020-11-20T12:14:38.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.282+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933415c7e0 con 0x7f9334138920 2020-11-20T12:14:38.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.283+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933415c970 con 0x7f9334138920 2020-11-20T12:14:38.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.284+0000 7f9328ff9700 1 -- 172.21.15.160:0/2601247557 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f932c001c50 con 0x7f9334138920 2020-11-20T12:14:38.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.285+0000 7f9328ff9700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f930c080630 0x7f930c082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.285+0000 7f9328ff9700 1 -- 172.21.15.160:0/2601247557 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f932c0a23c0 con 0x7f9334138920 2020-11-20T12:14:38.296 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.285+0000 7f933886d700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f930c080630 0x7f930c082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.296 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.286+0000 7f933886d700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f930c080630 0x7f930c082af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9330001150 tx=0x7f93340ba9e0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.296 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.289+0000 7f9328ff9700 1 -- 172.21.15.160:0/2601247557 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f932c076fc0 con 0x7f9334138920 2020-11-20T12:14:38.476 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.473+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9334044f60 con 0x7f9334138920 2020-11-20T12:14:38.477 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.474+0000 7f9328ff9700 1 -- 172.21.15.160:0/2601247557 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f932c07a5e0 con 0x7f9334138920 2020-11-20T12:14:38.477 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:38.479 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f930c080630 msgr2=0x7f930c082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.479 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f930c080630 0x7f930c082af0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f9330001150 tx=0x7f93340ba9e0).stop 2020-11-20T12:14:38.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9334138920 msgr2=0x7f9334138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9334138920 0x7f9334138d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f932c0010a0 tx=0x7f932c009040).stop 2020-11-20T12:14:38.480 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 shutdown_connections 2020-11-20T12:14:38.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f930c080630 0x7f930c082af0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9334138920 0x7f9334138d60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.481 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93200045d0 0x7f933415cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 --2- 172.21.15.160:0/2601247557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f933414d540 0x7f9334144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 >> 172.21.15.160:0/2601247557 conn(0x7f9334060140 msgr2=0x7f9334065800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:38.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.476+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 shutdown_connections 2020-11-20T12:14:38.482 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.477+0000 7f933986f700 1 -- 172.21.15.160:0/2601247557 wait complete. 2020-11-20T12:14:38.504 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T12:14:38.742 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.739+0000 7f3db62fc700 1 Processor -- start 2020-11-20T12:14:38.742 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.739+0000 7f3db62fc700 1 -- start start 2020-11-20T12:14:38.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.740+0000 7f3db62fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3db0061870 0x7f3db0061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.740+0000 7f3db62fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3db00bb650 0x7f3db00bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.740+0000 7f3db62fc700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db00c0880 con 0x7f3db00c0460 2020-11-20T12:14:38.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.740+0000 7f3db62fc700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00bbae0 con 0x7f3db00bb650 2020-11-20T12:14:38.745 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.740+0000 7f3db62fc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db00bbd80 con 0x7f3db0061870 2020-11-20T12:14:38.746 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.741+0000 7f3db52fa700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f3db0061870 0x7f3db0061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.741+0000 7f3db4af9700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f3db00bb650 0x7f3db00bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.741+0000 7f3db5afb700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f3db00c0460 0x7f3db0064fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47340/0 (socket says 172.21.15.160:47340) 2020-11-20T12:14:38.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.741+0000 7f3db5afb700 1 -- 172.21.15.160:0/3814447633 learned_addr learned my addr 172.21.15.160:0/3814447633 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:38.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.741+0000 7f3da3fff700 1 -- 172.21.15.160:0/3814447633 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010670169 0 0) 0x7f3db00c0880 con 0x7f3db00c0460 2020-11-20T12:14:38.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.741+0000 7f3db4af9700 1 -- 172.21.15.160:0/3814447633 >> v2:172.21.15.160:3300/0 conn(0x7f3db0061870 msgr2=0x7f3db0061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:38.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.742+0000 7f3db4af9700 1 --2- 172.21.15.160:0/3814447633 >> v2:172.21.15.160:3300/0 conn(0x7f3db0061870 0x7f3db0061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.742+0000 7f3db4af9700 1 -- 172.21.15.160:0/3814447633 >> v1:172.21.15.150:6789/0 conn(0x7f3db00c0460 legacy=0x7f3db0064fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.742+0000 7f3db4af9700 1 -- 172.21.15.160:0/3814447633 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db00bc560 con 0x7f3db00bb650 2020-11-20T12:14:38.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.742+0000 7f3db4af9700 1 --2- 172.21.15.160:0/3814447633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00bb650 0x7f3db00bcf40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3db00c3f00 tx=0x7f3dac00a370).ready entity=mon.1 client_cookie=efa81d3dcd92f5e3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.742+0000 7f3da3fff700 1 -- 172.21.15.160:0/3814447633 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00ce20 con 0x7f3db00bb650 2020-11-20T12:14:38.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.742+0000 7f3da3fff700 1 -- 172.21.15.160:0/3814447633 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac010410 con 0x7f3db00bb650 2020-11-20T12:14:38.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.742+0000 7f3da3fff700 1 -- 172.21.15.160:0/3814447633 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac010790 con 0x7f3db00bb650 2020-11-20T12:14:38.749 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 -- 172.21.15.160:0/3814447633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00bb650 msgr2=0x7f3db00bcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3814447633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00bb650 0x7f3db00bcf40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f3db00c3f00 tx=0x7f3dac00a370).stop 2020-11-20T12:14:38.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 -- 172.21.15.160:0/3814447633 shutdown_connections 2020-11-20T12:14:38.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3814447633 >> v2:172.21.15.160:3300/0 conn(0x7f3db0061870 0x7f3db0061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3814447633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00bb650 0x7f3db00bcf40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 -- 172.21.15.160:0/3814447633 >> 172.21.15.160:0/3814447633 conn(0x7f3db0060140 msgr2=0x7f3db0060520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:38.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 -- 172.21.15.160:0/3814447633 shutdown_connections 2020-11-20T12:14:38.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.743+0000 7f3db62fc700 1 -- 172.21.15.160:0/3814447633 wait complete. 2020-11-20T12:14:38.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.744+0000 7f3db62fc700 1 Processor -- start 2020-11-20T12:14:38.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.744+0000 7f3db62fc700 1 -- start start 2020-11-20T12:14:38.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.745+0000 7f3db62fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db0061870 0x7f3db014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.745+0000 7f3db62fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00c0460 0x7f3db01500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.745+0000 7f3db62fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db014ce30 0x7f3db01505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.745+0000 7f3db62fc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00bf030 con 0x7f3db0061870 2020-11-20T12:14:38.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.745+0000 7f3db62fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00bd7c0 con 0x7f3db00c0460 2020-11-20T12:14:38.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.745+0000 7f3db62fc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00bda60 con 0x7f3db014ce30 2020-11-20T12:14:38.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db014ce30 0x7f3db01505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db4af9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00c0460 0x7f3db01500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db52fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db0061870 0x7f3db014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db014ce30 0x7f3db01505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38502/0 (socket says 172.21.15.160:38502) 2020-11-20T12:14:38.755 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db4af9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00c0460 0x7f3db01500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51636/0 (socket says 172.21.15.160:51636) 2020-11-20T12:14:38.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 -- 172.21.15.160:0/3616801164 learned_addr learned my addr 172.21.15.160:0/3616801164 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:38.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 -- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00c0460 msgr2=0x7f3db01500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00c0460 0x7f3db01500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.756 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 -- 172.21.15.160:0/3616801164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db0061870 msgr2=0x7f3db014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db0061870 0x7f3db014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 -- 172.21.15.160:0/3616801164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db00bdd00 con 0x7f3db014ce30 2020-11-20T12:14:38.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.746+0000 7f3db5afb700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db014ce30 0x7f3db01505e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3da800c760 tx=0x7f3da8007c20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.747+0000 7f3da17fa700 1 -- 172.21.15.160:0/3616801164 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da80072e0 con 0x7f3db014ce30 2020-11-20T12:14:38.757 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.747+0000 7f3da17fa700 1 -- 172.21.15.160:0/3616801164 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8007440 con 0x7f3db014ce30 2020-11-20T12:14:38.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.747+0000 7f3da17fa700 1 -- 172.21.15.160:0/3616801164 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8005820 con 0x7f3db014ce30 2020-11-20T12:14:38.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.747+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db00bdfa0 con 0x7f3db014ce30 2020-11-20T12:14:38.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.747+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db00be4e0 con 0x7f3db014ce30 2020-11-20T12:14:38.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.748+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db015d0d0 con 0x7f3db014ce30 2020-11-20T12:14:38.759 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.749+0000 7f3da17fa700 1 -- 172.21.15.160:0/3616801164 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3da8010070 con 0x7f3db014ce30 2020-11-20T12:14:38.759 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.751+0000 7f3da17fa700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3d88080630 0x7f3d88082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.751+0000 7f3da17fa700 1 -- 172.21.15.160:0/3616801164 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f3da80a1f80 con 0x7f3db014ce30 2020-11-20T12:14:38.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.751+0000 7f3db52fa700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3d88080630 0x7f3d88082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.752+0000 7f3db52fa700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3d88080630 0x7f3d88082af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3da4006fd0 tx=0x7f3da4006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.754+0000 7f3da17fa700 1 -- 172.21.15.160:0/3616801164 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3da8076a70 con 0x7f3db014ce30 2020-11-20T12:14:38.940 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.937+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3db0044f60 con 0x7f3db014ce30 2020-11-20T12:14:38.941 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.938+0000 7f3da17fa700 1 -- 172.21.15.160:0/3616801164 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3da807a090 con 0x7f3db014ce30 2020-11-20T12:14:38.941 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:38.943 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3d88080630 msgr2=0x7f3d88082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.943 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3d88080630 0x7f3d88082af0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f3da4006fd0 tx=0x7f3da4006df0).stop 2020-11-20T12:14:38.944 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db014ce30 msgr2=0x7f3db01505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.944 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db014ce30 0x7f3db01505e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3da800c760 tx=0x7f3da8007c20).stop 2020-11-20T12:14:38.944 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 shutdown_connections 2020-11-20T12:14:38.945 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3d88080630 0x7f3d88082af0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.945 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3db014ce30 0x7f3db01505e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.945 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3db0061870 0x7f3db014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.945 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 --2- 172.21.15.160:0/3616801164 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3db00c0460 0x7f3db01500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.945 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 >> 172.21.15.160:0/3616801164 conn(0x7f3db0060140 msgr2=0x7f3db013f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:38.946 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 shutdown_connections 2020-11-20T12:14:38.946 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:38.940+0000 7f3db62fc700 1 -- 172.21.15.160:0/3616801164 wait complete. 2020-11-20T12:14:38.964 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T12:14:39.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.192+0000 7ff6deedd700 1 Processor -- start 2020-11-20T12:14:39.195 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.192+0000 7ff6deedd700 1 -- start start 2020-11-20T12:14:39.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.194+0000 7ff6deedd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff6d80bf720 0x7ff6d80bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.197 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.194+0000 7ff6deedd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80c25b0 con 0x7ff6d8151bc0 2020-11-20T12:14:39.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.194+0000 7ff6deedd700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80c2850 con 0x7ff6d80c2070 2020-11-20T12:14:39.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.194+0000 7ff6deedd700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d80c2af0 con 0x7ff6d80bf720 2020-11-20T12:14:39.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.194+0000 7ff6ddedb700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7ff6d80bf720 0x7ff6d80bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.194+0000 7ff6de6dc700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff6d8151bc0 0x7ff6d8154780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47354/0 (socket says 172.21.15.160:47354) 2020-11-20T12:14:39.198 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.194+0000 7ff6de6dc700 1 -- 172.21.15.160:0/3689893298 learned_addr learned my addr 172.21.15.160:0/3689893298 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:14:39.200 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6ddedb700 1 -- 172.21.15.160:0/3689893298 >> v1:172.21.15.160:6789/0 conn(0x7ff6d80c2070 legacy=0x7ff6d81514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.200 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6ddedb700 1 -- 172.21.15.160:0/3689893298 >> v1:172.21.15.150:6789/0 conn(0x7ff6d8151bc0 legacy=0x7ff6d8154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.200 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6dced9700 1 -- 172.21.15.160:0/3689893298 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600297240 0 0) 0x7ff6d80c25b0 con 0x7ff6d8151bc0 2020-11-20T12:14:39.200 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6ddedb700 1 -- 172.21.15.160:0/3689893298 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80c2d90 con 0x7ff6d80bf720 2020-11-20T12:14:39.201 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6ddedb700 1 --2- 172.21.15.160:0/3689893298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d80bf720 0x7ff6d80bfb00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff6d400b9a0 tx=0x7ff6d4006df0).ready entity=mon.1 client_cookie=e611750e6ff5ffd2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.201 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6dced9700 1 -- 172.21.15.160:0/3689893298 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4009840 con 0x7ff6d80bf720 2020-11-20T12:14:39.201 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6dced9700 1 -- 172.21.15.160:0/3689893298 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d40099a0 con 0x7ff6d80bf720 2020-11-20T12:14:39.201 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.195+0000 7ff6dced9700 1 -- 172.21.15.160:0/3689893298 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4009d20 con 0x7ff6d80bf720 2020-11-20T12:14:39.202 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.196+0000 7ff6deedd700 1 -- 172.21.15.160:0/3689893298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d80bf720 msgr2=0x7ff6d80bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.202 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.196+0000 7ff6deedd700 1 --2- 172.21.15.160:0/3689893298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d80bf720 0x7ff6d80bfb00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7ff6d400b9a0 tx=0x7ff6d4006df0).stop 2020-11-20T12:14:39.202 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.196+0000 7ff6deedd700 1 -- 172.21.15.160:0/3689893298 shutdown_connections 2020-11-20T12:14:39.202 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.196+0000 7ff6deedd700 1 --2- 172.21.15.160:0/3689893298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d80bf720 0x7ff6d80bfb00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.202 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.196+0000 7ff6deedd700 1 -- 172.21.15.160:0/3689893298 >> 172.21.15.160:0/3689893298 conn(0x7ff6d8060140 msgr2=0x7ff6d8060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.202 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.196+0000 7ff6deedd700 1 -- 172.21.15.160:0/3689893298 shutdown_connections 2020-11-20T12:14:39.203 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.196+0000 7ff6deedd700 1 -- 172.21.15.160:0/3689893298 wait complete. 2020-11-20T12:14:39.204 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.197+0000 7ff6deedd700 1 Processor -- start 2020-11-20T12:14:39.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.198+0000 7ff6deedd700 1 -- start start 2020-11-20T12:14:39.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.198+0000 7ff6deedd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6d80bf720 0x7ff6d81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.198+0000 7ff6deedd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6d80c2070 0x7ff6d8111fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.205 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6deedd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d8151bc0 0x7ff6d814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6deedd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8160e90 con 0x7ff6d80c2070 2020-11-20T12:14:39.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6deedd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8112810 con 0x7ff6d8151bc0 2020-11-20T12:14:39.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6deedd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d8163530 con 0x7ff6d80bf720 2020-11-20T12:14:39.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6d80bf720 0x7ff6d81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.206 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6d80bf720 0x7ff6d81609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38512/0 (socket says 172.21.15.160:38512) 2020-11-20T12:14:39.207 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 -- 172.21.15.160:0/4223035027 learned_addr learned my addr 172.21.15.160:0/4223035027 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:39.207 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6de6dc700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d8151bc0 0x7ff6d814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.207 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6dd6da700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6d80c2070 0x7ff6d8111fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.207 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 -- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d8151bc0 msgr2=0x7ff6d814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.208 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d8151bc0 0x7ff6d814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.208 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 -- 172.21.15.160:0/4223035027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6d80c2070 msgr2=0x7ff6d8111fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.208 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6d80c2070 0x7ff6d8111fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.208 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 -- 172.21.15.160:0/4223035027 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d81637d0 con 0x7ff6d80bf720 2020-11-20T12:14:39.208 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6dd6da700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6d80c2070 0x7ff6d8111fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:39.209 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.199+0000 7ff6ddedb700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6d80bf720 0x7ff6d81609a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff6d8066f30 tx=0x7ff6d4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.209 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.200+0000 7ff6c5ffb700 1 -- 172.21.15.160:0/4223035027 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4011e80 con 0x7ff6d80bf720 2020-11-20T12:14:39.209 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.200+0000 7ff6c5ffb700 1 -- 172.21.15.160:0/4223035027 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d401d5d0 con 0x7ff6d80bf720 2020-11-20T12:14:39.209 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.200+0000 7ff6c5ffb700 1 -- 172.21.15.160:0/4223035027 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d401d950 con 0x7ff6d80bf720 2020-11-20T12:14:39.210 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.200+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d8163a70 con 0x7ff6d80bf720 2020-11-20T12:14:39.210 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.200+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d8163fb0 con 0x7ff6d80bf720 2020-11-20T12:14:39.210 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.201+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d80611e0 con 0x7ff6d80bf720 2020-11-20T12:14:39.211 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.202+0000 7ff6c5ffb700 1 -- 172.21.15.160:0/4223035027 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff6d4025030 con 0x7ff6d80bf720 2020-11-20T12:14:39.211 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.203+0000 7ff6c5ffb700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff6b0080630 0x7ff6b0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.211 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.203+0000 7ff6c5ffb700 1 -- 172.21.15.160:0/4223035027 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7ff6d40a4400 con 0x7ff6d80bf720 2020-11-20T12:14:39.211 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.203+0000 7ff6dd6da700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff6b0080630 0x7ff6b0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.212 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.204+0000 7ff6dd6da700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff6b0080630 0x7ff6b0082af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff6d814ca00 tx=0x7ff6c8009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.212 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.206+0000 7ff6c5ffb700 1 -- 172.21.15.160:0/4223035027 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff6d4078f30 con 0x7ff6d80bf720 2020-11-20T12:14:39.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.384+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6d8044f60 con 0x7ff6d80bf720 2020-11-20T12:14:39.388 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.385+0000 7ff6c5ffb700 1 -- 172.21.15.160:0/4223035027 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff6d4023020 con 0x7ff6d80bf720 2020-11-20T12:14:39.388 INFO:teuthology.orchestra.run.smithi160.stdout:pg_num: 8 2020-11-20T12:14:39.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff6b0080630 msgr2=0x7ff6b0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.391 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff6b0080630 0x7ff6b0082af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7ff6d814ca00 tx=0x7ff6c8009040).stop 2020-11-20T12:14:39.391 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6d80bf720 msgr2=0x7ff6d81609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.391 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6d80bf720 0x7ff6d81609a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff6d8066f30 tx=0x7ff6d4015000).stop 2020-11-20T12:14:39.391 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 shutdown_connections 2020-11-20T12:14:39.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff6b0080630 0x7ff6b0082af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff6d8151bc0 0x7ff6d814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6d80bf720 0x7ff6d81609a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 --2- 172.21.15.160:0/4223035027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6d80c2070 0x7ff6d8111fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 >> 172.21.15.160:0/4223035027 conn(0x7ff6d8060140 msgr2=0x7ff6d8064390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.387+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 shutdown_connections 2020-11-20T12:14:39.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.388+0000 7ff6deedd700 1 -- 172.21.15.160:0/4223035027 wait complete. 2020-11-20T12:14:39.414 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T12:14:39.414 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T12:14:39.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.650+0000 7f978759e700 1 Processor -- start 2020-11-20T12:14:39.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.650+0000 7f978759e700 1 -- start start 2020-11-20T12:14:39.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.652+0000 7f978759e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9788061870 0x7f9788061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.652+0000 7f978759e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f97880c0510 0x7f97880bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.652+0000 7f978759e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9788150ed0 con 0x7f97880bb790 2020-11-20T12:14:39.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.652+0000 7f978759e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9788151170 con 0x7f97880c0510 2020-11-20T12:14:39.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.652+0000 7f978759e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9788151410 con 0x7f9788061870 2020-11-20T12:14:39.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.652+0000 7f978659c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9788061870 0x7f9788061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f977dd9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f97880c0510 0x7f97880bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f978659c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f9788061870 0x7f9788061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38520/0 (socket says 172.21.15.160:38520) 2020-11-20T12:14:39.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f978659c700 1 -- 172.21.15.160:0/2461361503 learned_addr learned my addr 172.21.15.160:0/2461361503 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:39.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f977dd9b700 1 --2- 172.21.15.160:0/2461361503 >> v2:172.21.15.150:3300/0 conn(0x7f97880c0510 0x7f97880bb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51658/0 (socket says 172.21.15.160:51658) 2020-11-20T12:14:39.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f9786d9d700 1 --1- 172.21.15.160:0/2461361503 >> v1:172.21.15.160:6789/0 conn(0x7f97880bb790 0x7f9788064f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56104/0 (socket says 172.21.15.160:56104) 2020-11-20T12:14:39.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f977dd9b700 1 -- 172.21.15.160:0/2461361503 >> v2:172.21.15.160:3300/0 conn(0x7f9788061870 msgr2=0x7f9788061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:39.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f977dd9b700 1 --2- 172.21.15.160:0/2461361503 >> v2:172.21.15.160:3300/0 conn(0x7f9788061870 0x7f9788061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f977dd9b700 1 -- 172.21.15.160:0/2461361503 >> v1:172.21.15.160:6789/0 conn(0x7f97880bb790 legacy=0x7f9788064f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f977dd9b700 1 -- 172.21.15.160:0/2461361503 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97881516b0 con 0x7f97880c0510 2020-11-20T12:14:39.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.653+0000 7f977dd9b700 1 --2- 172.21.15.160:0/2461361503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97880c0510 0x7f97880bb2a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f978805c2a0 tx=0x7f9770006df0).ready entity=mon.1 client_cookie=aec412ce5a4fdba6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f9785d9b700 1 -- 172.21.15.160:0/2461361503 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770009840 con 0x7f97880c0510 2020-11-20T12:14:39.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f9785d9b700 1 -- 172.21.15.160:0/2461361503 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97700099a0 con 0x7f97880c0510 2020-11-20T12:14:39.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f9785d9b700 1 -- 172.21.15.160:0/2461361503 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770009d20 con 0x7f97880c0510 2020-11-20T12:14:39.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 -- 172.21.15.160:0/2461361503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97880c0510 msgr2=0x7f97880bb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 --2- 172.21.15.160:0/2461361503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97880c0510 0x7f97880bb2a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f978805c2a0 tx=0x7f9770006df0).stop 2020-11-20T12:14:39.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 -- 172.21.15.160:0/2461361503 shutdown_connections 2020-11-20T12:14:39.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 --2- 172.21.15.160:0/2461361503 >> v2:172.21.15.160:3300/0 conn(0x7f9788061870 0x7f9788061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 --2- 172.21.15.160:0/2461361503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f97880c0510 0x7f97880bb2a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 -- 172.21.15.160:0/2461361503 >> 172.21.15.160:0/2461361503 conn(0x7f9788062ef0 msgr2=0x7f9788063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 -- 172.21.15.160:0/2461361503 shutdown_connections 2020-11-20T12:14:39.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.654+0000 7f978759e700 1 -- 172.21.15.160:0/2461361503 wait complete. 2020-11-20T12:14:39.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.656+0000 7f978759e700 1 Processor -- start 2020-11-20T12:14:39.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.656+0000 7f978759e700 1 -- start start 2020-11-20T12:14:39.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f978759e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9788061870 0x7f97880bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f978759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97880bb790 0x7f9788112210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f978759e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97880c0510 0x7f97880bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f978759e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788112a60 con 0x7f97880c0510 2020-11-20T12:14:39.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f978759e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97881636c0 con 0x7f9788061870 2020-11-20T12:14:39.665 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f978759e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788163960 con 0x7f97880bb790 2020-11-20T12:14:39.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f977dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97880bb790 0x7f9788112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f978659c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9788061870 0x7f97880bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f9786d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97880c0510 0x7f97880bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f977dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97880bb790 0x7f9788112210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38528/0 (socket says 172.21.15.160:38528) 2020-11-20T12:14:39.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.657+0000 7f977dd9b700 1 -- 172.21.15.160:0/3340628 learned_addr learned my addr 172.21.15.160:0/3340628 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:14:39.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977dd9b700 1 -- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9788061870 msgr2=0x7f97880bebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977dd9b700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9788061870 0x7f97880bebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977dd9b700 1 -- 172.21.15.160:0/3340628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97880c0510 msgr2=0x7f97880bbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977dd9b700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97880c0510 0x7f97880bbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977dd9b700 1 -- 172.21.15.160:0/3340628 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788163c00 con 0x7f97880bb790 2020-11-20T12:14:39.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f978659c700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9788061870 0x7f97880bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:39.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977dd9b700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97880bb790 0x7f9788112210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9770006e30 tx=0x7f9770015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977effd700 1 -- 172.21.15.160:0/3340628 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770011dd0 con 0x7f97880bb790 2020-11-20T12:14:39.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977effd700 1 -- 172.21.15.160:0/3340628 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977001e460 con 0x7f97880bb790 2020-11-20T12:14:39.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9788163ea0 con 0x7f97880bb790 2020-11-20T12:14:39.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.658+0000 7f977effd700 1 -- 172.21.15.160:0/3340628 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977001e800 con 0x7f97880bb790 2020-11-20T12:14:39.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.659+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788112700 con 0x7f97880bb790 2020-11-20T12:14:39.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.660+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9788164300 con 0x7f97880bb790 2020-11-20T12:14:39.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.661+0000 7f977effd700 1 -- 172.21.15.160:0/3340628 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9770025030 con 0x7f97880bb790 2020-11-20T12:14:39.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.662+0000 7f977effd700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9764080630 0x7f9764082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.662+0000 7f977effd700 1 -- 172.21.15.160:0/3340628 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f97700a4860 con 0x7f97880bb790 2020-11-20T12:14:39.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.662+0000 7f978659c700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9764080630 0x7f9764082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.663+0000 7f978659c700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9764080630 0x7f9764082af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f9778006a10 tx=0x7f9778008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.664+0000 7f977effd700 1 -- 172.21.15.160:0/3340628 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9770079350 con 0x7f97880bb790 2020-11-20T12:14:39.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.911+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9788044f60 con 0x7f97880bb790 2020-11-20T12:14:39.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.912+0000 7f977effd700 1 -- 172.21.15.160:0/3340628 <== mon.2 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f977002d030 con 0x7f97880bb790 2020-11-20T12:14:39.915 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:14:39.916 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4297,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/70698057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":70698057},{"type":"v1","addr":"172.21.15.150:6835","nonce":70698057}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4305,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/1085571547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":1085571547},{"type":"v1","addr":"172.21.15.134:6833","nonce":1085571547}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T12:14:10.878025+0000","modified":"2020-11-20T12:14:14.341505+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6833/2973718049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2973718049},{"type":"v1","addr":"172.21.15.160:6833","nonce":2973718049}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T12:14:39.917 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.914+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9764080630 msgr2=0x7f9764082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.914+0000 7f978759e700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9764080630 0x7f9764082af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f9778006a10 tx=0x7f9778008040).stop 2020-11-20T12:14:39.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.914+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97880bb790 msgr2=0x7f9788112210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.914+0000 7f978759e700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97880bb790 0x7f9788112210 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f9770006e30 tx=0x7f9770015000).stop 2020-11-20T12:14:39.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 shutdown_connections 2020-11-20T12:14:39.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9764080630 0x7f9764082af0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97880c0510 0x7f97880bbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9788061870 0x7f97880bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 --2- 172.21.15.160:0/3340628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97880bb790 0x7f9788112210 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 >> 172.21.15.160:0/3340628 conn(0x7f9788062ef0 msgr2=0x7f97880bf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 shutdown_connections 2020-11-20T12:14:39.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:14:39.915+0000 7f978759e700 1 -- 172.21.15.160:0/3340628 wait complete. 2020-11-20T12:14:39.921 INFO:teuthology.orchestra.run.smithi160.stderr:dumped fsmap epoch 8 2020-11-20T12:14:40.244 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T12:14:10.878025+0000', 'modified': '2020-11-20T12:14:14.341505+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4308}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4308': {'gid': 4308, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6833/2973718049', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 2973718049}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 2973718049}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T12:14:40.244 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T12:14:40.245 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-11-20T12:14:40.535 INFO:teuthology.orchestra.run.smithi160.stdout:{"cluster_fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","whoami":0,"id":4308,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.630558704999999,"mdsmap_epoch":8,"osdmap_epoch":26,"osdmap_epoch_barrier":26,"uptime":34.145572094999999} 2020-11-20T12:14:40.536 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "9013b66f-4346-4464-9f02-9fb5fd49fe5a", "fs_name": "cephfs", "id": 4308, "mdsmap_epoch": 8, "osdmap_epoch": 26, "osdmap_epoch_barrier": 26, "rank_uptime": 29.630558705, "state": "up:active", "uptime": 34.145572095, "want_state": "up:active", "whoami": 0 } 2020-11-20T12:14:40.536 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2020-11-20T12:14:40.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:40.537 INFO:teuthology.orchestra.run.smithi160:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:40.596 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-11-20T12:14:40.596 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T12:14:40.743 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T12:14:40.743 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T12:14:41.263 INFO:teuthology.orchestra.run.smithi160.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T12:14:41.263 INFO:teuthology.orchestra.run.smithi160.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T12:14:41.271 INFO:tasks.cephfs.kernel_mount:mount command passed 2020-11-20T12:14:41.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:41.271 INFO:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:41.384 INFO:teuthology.run_tasks:Running task check-counter... 2020-11-20T12:14:41.402 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T12:14:41.422 INFO:tasks.workunit:Pulling workunits from ref b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:14:41.423 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T12:14:41.424 INFO:tasks.workunit:timeout=3h 2020-11-20T12:14:41.424 INFO:tasks.workunit:cleanup=True 2020-11-20T12:14:41.425 INFO:teuthology.orchestra.run.smithi160:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:41.496 INFO:teuthology.orchestra.run.smithi160.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:41.496 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2020-11-20T12:14:41.497 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 28h/40d Inode: 1 Links: 2 2020-11-20T12:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:14:41.499 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:cephfs_t:s0 2020-11-20T12:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T12:14:41.500 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2020-11-20 12:14:10.882549063 +0000 2020-11-20T12:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2020-11-20 12:14:41.374055001 +0000 2020-11-20T12:14:41.501 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2020-11-20T12:14:41.502 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:41.503 INFO:teuthology.orchestra.run.smithi160:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T12:14:41.628 INFO:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:14:41.736 INFO:tasks.workunit.client.0.smithi160.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-11-20T12:14:50.817 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:50.829 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:50.836 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:20.987 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:21.000 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:21.007 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:36.364 INFO:tasks.workunit.client.0.smithi160.stderr:Checking out files: 64% (6293/9786) Checking out files: 65% (6361/9786) Checking out files: 66% (6459/9786) Checking out files: 67% (6557/9786) Checking out files: 68% (6655/9786) Checking out files: 69% (6753/9786) Checking out files: 70% (6851/9786) Checking out files: 71% (6949/9786) Checking out files: 72% (7046/9786) Checking out files: 73% (7144/9786) Checking out files: 74% (7242/9786) Checking out files: 75% (7340/9786) Checking out files: 76% (7438/9786) Checking out files: 77% (7536/9786) Checking out files: 78% (7634/9786) Checking out files: 79% (7731/9786) Checking out files: 80% (7829/9786) Checking out files: 81% (7927/9786) Checking out files: 82% (8025/9786) Checking out files: 83% (8123/9786) Checking out files: 84% (8221/9786) Checking out files: 85% (8319/9786) Checking out files: 86% (8416/9786) Checking out files: 87% (8514/9786) Checking out files: 88% (8612/9786) Checking out files: 89% (8710/9786) Checking out files: 90% (8808/9786) Checking out files: 91% (8906/9786) Checking out files: 92% (9004/9786) Checking out files: 93% (9101/9786) Checking out files: 94% (9199/9786) Checking out files: 95% (9297/9786) Checking out files: 96% (9395/9786) Checking out files: 97% (9493/9786) Checking out files: 98% (9591/9786) Checking out files: 99% (9689/9786) Checking out files: 100% (9786/9786) Checking out files: 100% (9786/9786), done. 2020-11-20T12:15:37.367 INFO:tasks.workunit.client.0.smithi160.stderr:Note: checking out 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'. 2020-11-20T12:15:37.368 INFO:tasks.workunit.client.0.smithi160.stderr: 2020-11-20T12:15:37.368 INFO:tasks.workunit.client.0.smithi160.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-11-20T12:15:37.368 INFO:tasks.workunit.client.0.smithi160.stderr:changes and commit them, and you can discard any commits you make in this 2020-11-20T12:15:37.368 INFO:tasks.workunit.client.0.smithi160.stderr:state without impacting any branches by performing another checkout. 2020-11-20T12:15:37.368 INFO:tasks.workunit.client.0.smithi160.stderr: 2020-11-20T12:15:37.369 INFO:tasks.workunit.client.0.smithi160.stderr:If you want to create a new branch to retain commits you create, you may 2020-11-20T12:15:37.369 INFO:tasks.workunit.client.0.smithi160.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-11-20T12:15:37.369 INFO:tasks.workunit.client.0.smithi160.stderr: 2020-11-20T12:15:37.369 INFO:tasks.workunit.client.0.smithi160.stderr: git checkout -b 2020-11-20T12:15:37.370 INFO:tasks.workunit.client.0.smithi160.stderr: 2020-11-20T12:15:37.370 INFO:tasks.workunit.client.0.smithi160.stderr:HEAD is now at b86e691bf1 Merge PR #37174 into wip-pdonnell-testing-20201120.053228 2020-11-20T12:15:37.388 INFO:teuthology.orchestra.run.smithi160:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-11-20T12:15:37.462 INFO:tasks.workunit.client.0.smithi160.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-11-20T12:15:37.470 INFO:tasks.workunit.client.0.smithi160.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T12:15:37.470 INFO:tasks.workunit.client.0.smithi160.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-11-20T12:15:38.575 INFO:tasks.workunit.client.0.smithi160.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-11-20T12:15:38.681 INFO:tasks.workunit.client.0.smithi160.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-11-20T12:15:38.771 INFO:tasks.workunit.client.0.smithi160.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T12:15:38.777 INFO:tasks.workunit.client.0.smithi160.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T12:15:38.777 INFO:tasks.workunit.client.0.smithi160.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-11-20T12:15:38.861 INFO:tasks.workunit.client.0.smithi160.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T12:15:38.872 INFO:teuthology.orchestra.run.smithi160:> set -ex 2020-11-20T12:15:38.873 INFO:teuthology.orchestra.run.smithi160:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T12:15:38.920 INFO:teuthology.orchestra.run.smithi160.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T12:15:38.922 INFO:teuthology.orchestra.run.smithi160.stdout:rename/prepare.shrename/pri_rem.shrename/pri_nul.shrename/dir_pri_pri.shrename/pri_pri.shrename/rem_nul.shrename/dir_pri_nul.shrename/rem_pri.shrename/rem_rem.shrename/all.shcaps/mon_commands.shdirect_io/big.shdirect_io/misc.shdirect_io/test_short_dio_readdirect_io/direct_io_testdirect_io/test_sync_iokernel_untar_build.shlibcephfs/test.shcephtool/test_daemon.shcephtool/test.shcephtool/test_kvstore_tool.shmgr/test_localpool.shrgw/s3_bucket_quota.plrgw/test_rgw_orphan_list.shrgw/test_rgw_throttle.shrgw/test_rgw_gc_log.shrgw/run-s3tests.shrgw/s3_user_quota.plrgw/test_rgw_obj.shrgw/run-reshard.shrgw/test_rgw_reshard.pyrgw/s3_multipart_upload.plosdc/stress_objectcacher.shpost-file.shsuites/blogbench.shsuites/dbench.shsuites/fsx.shsuites/ffsb.shsuites/fsstress.shsuites/iogen.shsuites/cephfs_journal_tool_smoke.shsuites/fsync-tester.shsuites/dbench-short.shsuites/pjd.shsuites/bonnie.shsuites/iozone.shsuites/iozone-sync.shsuites/fio.shrados/stress_watch.shrados/test_cache_pool.shrados/clone.shrados/test_python.shrados/test_pool_access.shrados/test_crash.shrados/load-gen-mix.shrados/test_health_warnings.shrados/load-gen-mostlyread.shrados/test_pool_quota.shrados/load-gen-mix-small-long.shrados/load-gen-big.shrados/test_librados_build.shrados/test_hang.shrados/version_number_sanity.shrados/test_dedup_tool.shrados/test_envlibrados_for_rocksdb.shrados/test_large_omap_detection.pyrados/test_alloc_hint.shrados/test_rados_timeouts.shrados/load-gen-mix-small.shrados/test.shrados/test_rados_tool.shobjectstore/test_fuse.shcephadm/test_cephadm.shcephadm/create_iscsi_disks.shcephadm/test_adoption.shcephadm/test_dashboard_e2e.shcephadm/test_repos.shceph-helpers-root.sherasure-code/encode-decode-non-regression.sherasure-code/bench.shfs/test_o_truncfs/snap-hierarchy.shfs/norstats/kernel_untar_tar.shfs/test_python.shfs/misc/multiple_rsync.shfs/misc/layout_vxattrs.shfs/misc/chmod.shfs/misc/dirfrag.shfs/misc/xattrs.shfs/misc/filelock_interrupt.pyfs/misc/filelock_deadlock.pyfs/misc/rstats.shfs/misc/subvolume.shfs/misc/trivial_sync.shfs/misc/i_complete_vs_rename.shfs/misc/acl.shfs/misc/mkpool_layout_vxattrs.shfs/misc/direct_io.pyfs/quota/quota.shfs/upgrade/volume_clientfs/snaps/snaptest-double-null.shfs/snaps/snaptest-git-ceph.shfs/snaps/snaptest-2.shfs/snaps/snaptest-dir-rename.shfs/snaps/snaptest-0.shfs/snaps/snaptest-1.shfs/snaps/untar_snap_rm.shfs/snaps/snaptest-hardlink.shfs/snaps/snap-rm-diff.shfs/snaps/snaptest-authwb.shfs/snaps/snaptest-snap-rm-cmp.shfs/snaps/snaptest-intodir.shfs/snaps/snaptest-upchildrealms.shfs/snaps/snaptest-realm-split.shfs/snaps/snaptest-capwb.shfs/snaps/snaptest-parents.shfs/snaps/snaptest-xattrwb.shfs/snaps/snaptest-multiple-capsnaps.shfs/snaps/snaptest-estale.shfs/snaps/snaptest-snap-rename.shfs/test_o_trunc.shfs/multiclient_sync_read_eof.pycls/test_cls_rgw.shcls/test_cls_rbd.shcls/test_cls_hello.shcls/test_cls_sdk.shcls/test_cls_log.shcls/test_cls_lock.shcls/test_cls_cmpomap.shcls/test_cls_journal.shcls/test_cls_2pc_queue.shcls/test_cls_numops.shcls/test_cls_refcount.shrest/test_mgr_rest_api.pyrest/test-restful.shrbd/test_admin_socket.shrbd/test_rbdmap_RBDMAPFILE.shrbd/notify_master.shrbd/journal.shrbd/krbd_stable_pages_required.shrbd/rbd_mirror_snapshot.shrbd/krbd_namespaces.shrbd/krbd_udev_netlink_enobufs.shrbd/rbd_mirror_fsx_prepare.shrbd/krbd_huge_osdmap.shrbd/diff.shrbd/rbd_mirror_bootstrap.shrbd/simple_big.shrbd/krbd_fallocate.shrbd/test_librbd.shrbd/rbd_mirror_fsx_compare.shrbd/qemu-iotests.shrbd/krbd_udev_enumerate.shrbd/concurrent.shrbd/rbd-ggate.shrbd/krbd_latest_osdmap_on_map.shrbd/issue-20295.shrbd/import_export.shrbd/notify_slave.shrbd/cli_generic.shrbd/qemu_dynamic_features.shrbd/krbd_data_pool.shrbd/krbd_udev_netns.shrbd/rbd_mirror_ha.shrbd/rbd-nbd.shrbd/rbd_mirror_journal.shrbd/test_librbd_python.shrbd/read-flags.shrbd/krbd_exclusive_option.shrbd/huge-tickets.shrbd/map-snapshot-io.shrbd/image_read.shrbd/diff_continuous.shrbd/permissions.shrbd/map-unmap.shrbd/merge_diff.shrbd/test_rbd_tasks.shrbd/test_lock_fence.shrbd/rbd_mirror_helpers.shrbd/qos.shrbd/kernel.shrbd/krbd_wac.shrbd/rbd_mirror_stress.shrbd/qemu_rebuild_object_map.shrbd/krbd_udev_symlinks.shrbd/rbd_groups.shrbd/verify_pool.shrbd/test_rbd_mirror.shrestart/test-backtraces.pymon/pool_ops.shmon/test_mon_config_key.pymon/caps.shmon/rbd_snaps_ops.shmon/auth_caps.shmon/pg_autoscaler.shmon/test_config_key_caps.shmon/osd.shmon/config.shmon/ping.pymon/test_mon_osdmap_prune.shmon/crush_ops.shceph-tests/ceph-admin-commands.shtrue.shhadoop/terasort.shhadoop/repl.shhadoop/wordcount.sh 2020-11-20T12:15:38.923 INFO:teuthology.orchestra.run.smithi160.stderr:9+1 records in 2020-11-20T12:15:38.923 INFO:teuthology.orchestra.run.smithi160.stderr:9+1 records out 2020-11-20T12:15:38.923 INFO:teuthology.orchestra.run.smithi160.stderr:4744 bytes (4.7 kB, 4.6 KiB) copied, 0.000187078 s, 25.4 MB/s 2020-11-20T12:15:38.924 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2020-11-20T12:15:38.925 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2020-11-20T12:15:38.926 INFO:teuthology.orchestra.run.smithi160:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b86e691bf191566922a8f08e2a5abf64fde8cfcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2020-11-20T12:15:39.002 INFO:tasks.workunit.client.0.smithi160.stdout:getting blogbench 2020-11-20T12:15:39.048 INFO:tasks.workunit.client.0.smithi160.stderr:--2020-11-20 12:15:39-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2020-11-20T12:15:39.066 INFO:tasks.workunit.client.0.smithi160.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2020-11-20T12:15:39.143 INFO:tasks.workunit.client.0.smithi160.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2020-11-20T12:15:39.220 INFO:tasks.workunit.client.0.smithi160.stderr:HTTP request sent, awaiting response... 200 OK 2020-11-20T12:15:39.221 INFO:tasks.workunit.client.0.smithi160.stderr:Length: 103355 (101K) [application/octet-stream] 2020-11-20T12:15:39.224 INFO:tasks.workunit.client.0.smithi160.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2020-11-20T12:15:39.232 INFO:tasks.workunit.client.0.smithi160.stderr: 2020-11-20T12:15:39.381 INFO:tasks.workunit.client.0.smithi160.stderr: 0K .......... .......... .......... .......... .......... 49% 322K 0s 2020-11-20T12:15:39.462 INFO:tasks.workunit.client.0.smithi160.stderr: 50K .......... .......... .......... .......... .......... 99% 615K 0s 2020-11-20T12:15:39.462 INFO:tasks.workunit.client.0.smithi160.stderr: 100K 100% 1779G=0.2s 2020-11-20T12:15:39.462 INFO:tasks.workunit.client.0.smithi160.stderr: 2020-11-20T12:15:39.462 INFO:tasks.workunit.client.0.smithi160.stderr:2020-11-20 12:15:39 (426 KB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2020-11-20T12:15:39.463 INFO:tasks.workunit.client.0.smithi160.stderr: 2020-11-20T12:15:39.547 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/ 2020-11-20T12:15:39.550 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/m4/ 2020-11-20T12:15:39.552 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/m4/acx_pthread.m4 2020-11-20T12:15:39.555 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/man/ 2020-11-20T12:15:39.557 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/man/blogbench.8 2020-11-20T12:15:39.560 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/man/Makefile.am 2020-11-20T12:15:39.562 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/man/Makefile.in 2020-11-20T12:15:39.564 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/ 2020-11-20T12:15:39.567 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/mysnprintf.c 2020-11-20T12:15:39.570 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/mysnprintf.h 2020-11-20T12:15:39.572 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/blogbench.c 2020-11-20T12:15:39.574 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/blogbench.h 2020-11-20T12:15:39.576 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/fakesnprintf.c 2020-11-20T12:15:39.578 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/fakesnprintf.h 2020-11-20T12:15:39.580 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/blogbench_p.h 2020-11-20T12:15:39.582 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/bsd-getopt_long.c 2020-11-20T12:15:39.584 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/bsd-getopt_long.h 2020-11-20T12:15:39.587 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/Makefile.am 2020-11-20T12:15:39.589 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/Makefile.in 2020-11-20T12:15:39.591 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/process.c 2020-11-20T12:15:39.593 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/globals.h 2020-11-20T12:15:39.595 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/commenter.c 2020-11-20T12:15:39.597 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/rewriter.c 2020-11-20T12:15:39.599 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/reader.c 2020-11-20T12:15:39.602 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/writer.c 2020-11-20T12:15:39.604 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/src/helpers.c 2020-11-20T12:15:39.606 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/NEWS 2020-11-20T12:15:39.609 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/compile 2020-11-20T12:15:39.611 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/depcomp 2020-11-20T12:15:39.613 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/aclocal.m4 2020-11-20T12:15:39.616 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/README 2020-11-20T12:15:39.618 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/configure 2020-11-20T12:15:39.629 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/configure.ac 2020-11-20T12:15:39.631 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/config.guess 2020-11-20T12:15:39.633 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/install-sh 2020-11-20T12:15:39.635 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/config.sub 2020-11-20T12:15:39.638 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/missing 2020-11-20T12:15:39.641 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/mkinstalldirs 2020-11-20T12:15:39.643 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/Makefile.am 2020-11-20T12:15:39.645 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/Makefile.in 2020-11-20T12:15:39.648 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/config.h.in 2020-11-20T12:15:39.652 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/AUTHORS 2020-11-20T12:15:39.655 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/INSTALL 2020-11-20T12:15:39.658 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/ChangeLog 2020-11-20T12:15:39.661 INFO:tasks.workunit.client.0.smithi160.stdout:blogbench-1.0/COPYING 2020-11-20T12:15:39.666 INFO:tasks.workunit.client.0.smithi160.stdout:making blogbench 2020-11-20T12:15:40.059 INFO:tasks.workunit.client.0.smithi160.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2020-11-20T12:15:41.081 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether build environment is sane... yes 2020-11-20T12:15:41.113 INFO:tasks.workunit.client.0.smithi160.stdout:checking for gawk... gawk 2020-11-20T12:15:41.167 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether make sets $(MAKE)... yes 2020-11-20T12:15:41.220 INFO:tasks.workunit.client.0.smithi160.stdout:checking for gcc... gcc 2020-11-20T12:15:41.367 INFO:tasks.workunit.client.0.smithi160.stdout:checking for C compiler default output file name... a.out 2020-11-20T12:15:41.374 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether the C compiler works... yes 2020-11-20T12:15:41.381 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether we are cross compiling... no 2020-11-20T12:15:41.465 INFO:tasks.workunit.client.0.smithi160.stdout:checking for suffix of executables... 2020-11-20T12:15:41.560 INFO:tasks.workunit.client.0.smithi160.stdout:checking for suffix of object files... o 2020-11-20T12:15:41.666 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether we are using the GNU C compiler... yes 2020-11-20T12:15:41.769 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether gcc accepts -g... yes 2020-11-20T12:15:41.960 INFO:tasks.workunit.client.0.smithi160.stdout:checking for gcc option to accept ANSI C... none needed 2020-11-20T12:15:42.063 INFO:tasks.workunit.client.0.smithi160.stdout:checking for style of include used by make... GNU 2020-11-20T12:15:42.292 INFO:tasks.workunit.client.0.smithi160.stdout:checking dependency style of gcc... gcc3 2020-11-20T12:15:42.294 INFO:tasks.workunit.client.0.smithi160.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2020-11-20T12:15:42.425 INFO:tasks.workunit.client.0.smithi160.stdout:checking how to run the C preprocessor... gcc -E 2020-11-20T12:15:42.528 INFO:tasks.workunit.client.0.smithi160.stdout:checking for egrep... grep -E 2020-11-20T12:15:42.552 INFO:tasks.workunit.client.0.smithi160.stdout:checking for AIX... no 2020-11-20T12:15:42.685 INFO:tasks.workunit.client.0.smithi160.stdout:checking for library containing strerror... none required 2020-11-20T12:15:43.019 INFO:tasks.workunit.client.0.smithi160.stdout:checking for ANSI C header files... yes 2020-11-20T12:15:43.128 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether time.h and sys/time.h may both be included... yes 2020-11-20T12:15:43.260 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sys/types.h... yes 2020-11-20T12:15:43.390 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sys/stat.h... yes 2020-11-20T12:15:43.519 INFO:tasks.workunit.client.0.smithi160.stdout:checking for stdlib.h... yes 2020-11-20T12:15:43.665 INFO:tasks.workunit.client.0.smithi160.stdout:checking for string.h... yes 2020-11-20T12:15:43.803 INFO:tasks.workunit.client.0.smithi160.stdout:checking for memory.h... yes 2020-11-20T12:15:43.941 INFO:tasks.workunit.client.0.smithi160.stdout:checking for strings.h... yes 2020-11-20T12:15:44.071 INFO:tasks.workunit.client.0.smithi160.stdout:checking for inttypes.h... yes 2020-11-20T12:15:44.214 INFO:tasks.workunit.client.0.smithi160.stdout:checking for stdint.h... yes 2020-11-20T12:15:44.366 INFO:tasks.workunit.client.0.smithi160.stdout:checking for unistd.h... yes 2020-11-20T12:15:44.400 INFO:tasks.workunit.client.0.smithi160.stdout:checking for memory.h... (cached) yes 2020-11-20T12:15:44.419 INFO:tasks.workunit.client.0.smithi160.stdout:checking for strings.h... (cached) yes 2020-11-20T12:15:44.440 INFO:tasks.workunit.client.0.smithi160.stdout:checking for unistd.h... (cached) yes 2020-11-20T12:15:44.565 INFO:tasks.workunit.client.0.smithi160.stdout:checking locale.h usability... yes 2020-11-20T12:15:44.676 INFO:tasks.workunit.client.0.smithi160.stdout:checking locale.h presence... yes 2020-11-20T12:15:44.682 INFO:tasks.workunit.client.0.smithi160.stdout:checking for locale.h... yes 2020-11-20T12:15:44.744 INFO:tasks.workunit.client.0.smithi160.stdout:checking for stdlib.h... (cached) yes 2020-11-20T12:15:44.762 INFO:tasks.workunit.client.0.smithi160.stdout:checking for string.h... (cached) yes 2020-11-20T12:15:44.912 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/socket.h usability... yes 2020-11-20T12:15:44.971 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/socket.h presence... yes 2020-11-20T12:15:44.975 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sys/socket.h... yes 2020-11-20T12:15:45.108 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/time.h usability... yes 2020-11-20T12:15:45.164 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/time.h presence... yes 2020-11-20T12:15:45.167 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sys/time.h... yes 2020-11-20T12:15:45.308 INFO:tasks.workunit.client.0.smithi160.stdout:checking fcntl.h usability... yes 2020-11-20T12:15:45.361 INFO:tasks.workunit.client.0.smithi160.stdout:checking fcntl.h presence... yes 2020-11-20T12:15:45.365 INFO:tasks.workunit.client.0.smithi160.stdout:checking for fcntl.h... yes 2020-11-20T12:15:45.511 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/fcntl.h usability... yes 2020-11-20T12:15:45.575 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/fcntl.h presence... yes 2020-11-20T12:15:45.580 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sys/fcntl.h... yes 2020-11-20T12:15:45.762 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/param.h usability... yes 2020-11-20T12:15:45.822 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/param.h presence... yes 2020-11-20T12:15:45.825 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sys/param.h... yes 2020-11-20T12:15:45.938 INFO:tasks.workunit.client.0.smithi160.stdout:checking ioctl.h usability... no 2020-11-20T12:15:45.989 INFO:tasks.workunit.client.0.smithi160.stdout:checking ioctl.h presence... no 2020-11-20T12:15:45.993 INFO:tasks.workunit.client.0.smithi160.stdout:checking for ioctl.h... no 2020-11-20T12:15:46.125 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/ioctl.h usability... yes 2020-11-20T12:15:46.181 INFO:tasks.workunit.client.0.smithi160.stdout:checking sys/ioctl.h presence... yes 2020-11-20T12:15:46.186 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sys/ioctl.h... yes 2020-11-20T12:15:46.317 INFO:tasks.workunit.client.0.smithi160.stdout:checking return type of signal handlers... void 2020-11-20T12:15:46.440 INFO:tasks.workunit.client.0.smithi160.stdout:checking for size_t... yes 2020-11-20T12:15:46.546 INFO:tasks.workunit.client.0.smithi160.stdout:checking for dev_t... yes 2020-11-20T12:15:46.654 INFO:tasks.workunit.client.0.smithi160.stdout:checking for short... yes 2020-11-20T12:15:46.807 INFO:tasks.workunit.client.0.smithi160.stdout:checking size of short... 2 2020-11-20T12:15:46.916 INFO:tasks.workunit.client.0.smithi160.stdout:checking for int... yes 2020-11-20T12:15:47.062 INFO:tasks.workunit.client.0.smithi160.stdout:checking size of int... 4 2020-11-20T12:15:47.177 INFO:tasks.workunit.client.0.smithi160.stdout:checking for long... yes 2020-11-20T12:15:47.320 INFO:tasks.workunit.client.0.smithi160.stdout:checking size of long... 8 2020-11-20T12:15:47.433 INFO:tasks.workunit.client.0.smithi160.stdout:checking for long long... yes 2020-11-20T12:15:47.580 INFO:tasks.workunit.client.0.smithi160.stdout:checking size of long long... 8 2020-11-20T12:15:47.723 INFO:tasks.workunit.client.0.smithi160.stdout:checking for ssize_t... yes 2020-11-20T12:15:47.837 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sig_atomic_t... yes 2020-11-20T12:15:47.993 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether gcc needs -traditional... no 2020-11-20T12:15:48.097 INFO:tasks.workunit.client.0.smithi160.stdout:checking for an ANSI C-conforming const... yes 2020-11-20T12:15:48.162 INFO:tasks.workunit.client.0.smithi160.stdout:checking for inline... inline 2020-11-20T12:15:48.308 INFO:tasks.workunit.client.0.smithi160.stdout:checking for working alloca.h... yes 2020-11-20T12:15:48.425 INFO:tasks.workunit.client.0.smithi160.stdout:checking for alloca... yes 2020-11-20T12:15:48.562 INFO:tasks.workunit.client.0.smithi160.stdout:checking for working memcmp... yes 2020-11-20T12:15:48.713 INFO:tasks.workunit.client.0.smithi160.stdout:checking for strftime... yes 2020-11-20T12:15:48.890 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2020-11-20T12:15:49.038 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether stat accepts an empty string... no 2020-11-20T12:15:49.186 INFO:tasks.workunit.client.0.smithi160.stdout:checking for vprintf... yes 2020-11-20T12:15:49.316 INFO:tasks.workunit.client.0.smithi160.stdout:checking for _doprnt... no 2020-11-20T12:15:49.391 INFO:tasks.workunit.client.0.smithi160.stdout:checking build system type... x86_64-unknown-linux-gnu 2020-11-20T12:15:49.432 INFO:tasks.workunit.client.0.smithi160.stdout:checking host system type... x86_64-unknown-linux-gnu 2020-11-20T12:15:49.563 INFO:tasks.workunit.client.0.smithi160.stdout:checking for the pthreads library -lpthreads... no 2020-11-20T12:15:49.690 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether pthreads work without any flags... no 2020-11-20T12:15:49.755 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether pthreads work with -Kthread... no 2020-11-20T12:15:49.812 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether pthreads work with -kthread... no 2020-11-20T12:15:49.918 INFO:tasks.workunit.client.0.smithi160.stdout:checking for the pthreads library -llthread... no 2020-11-20T12:15:50.076 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether pthreads work with -pthread... yes 2020-11-20T12:15:50.201 INFO:tasks.workunit.client.0.smithi160.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2020-11-20T12:15:50.202 INFO:tasks.workunit.client.0.smithi160.stdout:checking if more special flags are required for pthreads... no 2020-11-20T12:15:50.202 INFO:tasks.workunit.client.0.smithi160.stdout:checking for cc_r... gcc 2020-11-20T12:15:50.385 INFO:tasks.workunit.client.0.smithi160.stdout:checking for setrlimit... yes 2020-11-20T12:15:50.543 INFO:tasks.workunit.client.0.smithi160.stdout:checking for setproctitle... no 2020-11-20T12:15:50.698 INFO:tasks.workunit.client.0.smithi160.stdout:checking for getopt_long... yes 2020-11-20T12:15:50.855 INFO:tasks.workunit.client.0.smithi160.stdout:checking for strtoull... yes 2020-11-20T12:15:51.013 INFO:tasks.workunit.client.0.smithi160.stdout:checking for strtoq... yes 2020-11-20T12:15:51.141 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:51.144 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:51.147 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:51.167 INFO:tasks.workunit.client.0.smithi160.stdout:checking for snprintf... yes 2020-11-20T12:15:51.292 INFO:tasks.workunit.client.0.smithi160.stdout:checking for vsnprintf... yes 2020-11-20T12:15:51.444 INFO:tasks.workunit.client.0.smithi160.stdout:checking for vfprintf... yes 2020-11-20T12:15:51.603 INFO:tasks.workunit.client.0.smithi160.stdout:checking for gethostname... yes 2020-11-20T12:15:51.764 INFO:tasks.workunit.client.0.smithi160.stdout:checking for setlocale... yes 2020-11-20T12:15:51.936 INFO:tasks.workunit.client.0.smithi160.stdout:checking for sync... yes 2020-11-20T12:15:52.091 INFO:tasks.workunit.client.0.smithi160.stdout:checking whether snprintf is C99 conformant... done 2020-11-20T12:15:52.126 INFO:tasks.workunit.client.0.smithi160.stdout:configure: creating ./config.status 2020-11-20T12:15:52.603 INFO:tasks.workunit.client.0.smithi160.stdout:config.status: creating Makefile 2020-11-20T12:15:52.654 INFO:tasks.workunit.client.0.smithi160.stdout:config.status: creating src/Makefile 2020-11-20T12:15:52.710 INFO:tasks.workunit.client.0.smithi160.stdout:config.status: creating man/Makefile 2020-11-20T12:15:52.739 INFO:tasks.workunit.client.0.smithi160.stdout:config.status: creating config.h 2020-11-20T12:15:53.002 INFO:tasks.workunit.client.0.smithi160.stdout:config.status: executing depfiles commands 2020-11-20T12:15:53.448 INFO:tasks.workunit.client.0.smithi160.stdout:make all-recursive 2020-11-20T12:15:53.451 INFO:tasks.workunit.client.0.smithi160.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2020-11-20T12:15:53.461 INFO:tasks.workunit.client.0.smithi160.stdout:Making all in src 2020-11-20T12:15:53.474 INFO:tasks.workunit.client.0.smithi160.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2020-11-20T12:15:53.474 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2020-11-20T12:15:53.474 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2020-11-20T12:15:53.627 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2020-11-20T12:15:53.628 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2020-11-20T12:15:53.751 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2020-11-20T12:15:53.751 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2020-11-20T12:15:53.849 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2020-11-20T12:15:53.849 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2020-11-20T12:15:53.943 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2020-11-20T12:15:53.943 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2020-11-20T12:15:54.040 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2020-11-20T12:15:54.040 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2020-11-20T12:15:54.133 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2020-11-20T12:15:54.135 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2020-11-20T12:15:54.257 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2020-11-20T12:15:54.258 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2020-11-20T12:15:54.328 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2020-11-20T12:15:54.329 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2020-11-20T12:15:54.410 INFO:tasks.workunit.client.0.smithi160.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -pthread -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2020-11-20T12:15:54.411 INFO:tasks.workunit.client.0.smithi160.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2020-11-20T12:15:54.488 INFO:tasks.workunit.client.0.smithi160.stdout:gcc -g -O2 -pthread -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2020-11-20T12:15:54.531 INFO:tasks.workunit.client.0.smithi160.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2020-11-20T12:15:54.533 INFO:tasks.workunit.client.0.smithi160.stdout:Making all in man 2020-11-20T12:15:54.561 INFO:tasks.workunit.client.0.smithi160.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2020-11-20T12:15:54.561 INFO:tasks.workunit.client.0.smithi160.stdout:make[2]: Nothing to be done for 'all'. 2020-11-20T12:15:54.562 INFO:tasks.workunit.client.0.smithi160.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2020-11-20T12:15:54.567 INFO:tasks.workunit.client.0.smithi160.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2020-11-20T12:15:54.568 INFO:tasks.workunit.client.0.smithi160.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2020-11-20T12:15:54.570 INFO:tasks.workunit.client.0.smithi160.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2020-11-20T12:15:54.577 INFO:tasks.workunit.client.0.smithi160.stdout:running blogbench 2020-11-20T12:15:54.578 INFO:tasks.workunit.client.0.smithi160.stdout: 2020-11-20T12:15:54.578 INFO:tasks.workunit.client.0.smithi160.stdout:Frequency = 10 secs 2020-11-20T12:15:54.578 INFO:tasks.workunit.client.0.smithi160.stdout:Scratch dir = [blogtest_in] 2020-11-20T12:15:57.077 INFO:tasks.workunit.client.0.smithi160.stdout:Spawning 3 writers... 2020-11-20T12:15:57.078 INFO:tasks.workunit.client.0.smithi160.stdout:Spawning 1 rewriters... 2020-11-20T12:15:57.078 INFO:tasks.workunit.client.0.smithi160.stdout:Spawning 5 commenters... 2020-11-20T12:15:57.078 INFO:tasks.workunit.client.0.smithi160.stdout:Spawning 100 readers... 2020-11-20T12:15:57.089 INFO:tasks.workunit.client.0.smithi160.stdout:Benchmarking for 30 iterations. 2020-11-20T12:15:57.090 INFO:tasks.workunit.client.0.smithi160.stdout:The test will run during 5 minutes. 2020-11-20T12:15:57.090 INFO:tasks.workunit.client.0.smithi160.stdout: 2020-11-20T12:15:57.091 INFO:tasks.workunit.client.0.smithi160.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2020-11-20T12:16:07.089 INFO:tasks.workunit.client.0.smithi160.stdout: 13 188943 700 120086 638 61802 1259 2020-11-20T12:16:17.090 INFO:tasks.workunit.client.0.smithi160.stdout: 20 297189 577 166745 348 158733 1360 2020-11-20T12:16:21.258 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:21.261 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:21.264 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:27.093 INFO:tasks.workunit.client.0.smithi160.stdout: 23 290876 174 164134 159 162408 496 2020-11-20T12:16:37.098 INFO:tasks.workunit.client.0.smithi160.stdout: 34 413901 530 221361 356 232029 1363 2020-11-20T12:16:47.100 INFO:tasks.workunit.client.0.smithi160.stdout: 39 464626 434 256281 313 251356 982 2020-11-20T12:16:53.285 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:53.287 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:53.290 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:57.101 INFO:tasks.workunit.client.0.smithi160.stdout: 42 365176 214 212012 188 190004 599 2020-11-20T12:17:07.102 INFO:tasks.workunit.client.0.smithi160.stdout: 47 342156 296 197399 305 171993 755 2020-11-20T12:17:17.102 INFO:tasks.workunit.client.0.smithi160.stdout: 53 412115 241 246555 280 234771 737 2020-11-20T12:17:23.444 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:23.447 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:23.449 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:27.108 INFO:tasks.workunit.client.0.smithi160.stdout: 60 444220 456 274889 456 262849 994 2020-11-20T12:17:37.111 INFO:tasks.workunit.client.0.smithi160.stdout: 64 421124 292 270511 379 242851 979 2020-11-20T12:17:47.111 INFO:tasks.workunit.client.0.smithi160.stdout: 65 335825 120 219474 157 190915 420 2020-11-20T12:17:53.615 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:53.618 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:53.621 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:57.117 INFO:tasks.workunit.client.0.smithi160.stdout: 72 424057 407 281079 331 249907 1181 2020-11-20T12:18:07.119 INFO:tasks.workunit.client.0.smithi160.stdout: 77 394374 254 260010 176 224108 588 2020-11-20T12:18:17.118 INFO:tasks.workunit.client.0.smithi160.stdout: 81 450794 329 301419 401 270388 1199 2020-11-20T12:18:23.788 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:23.988 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:23.991 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:27.119 INFO:tasks.workunit.client.0.smithi160.stdout: 83 347721 244 235912 175 221826 596 2020-11-20T12:18:37.119 INFO:tasks.workunit.client.0.smithi160.stdout: 88 431719 355 298211 299 268966 971 2020-11-20T12:18:47.119 INFO:tasks.workunit.client.0.smithi160.stdout: 91 378566 309 258630 325 241461 811 2020-11-20T12:18:54.794 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:54.797 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:54.800 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:57.120 INFO:tasks.workunit.client.0.smithi160.stdout: 95 374582 243 254857 208 234042 627 2020-11-20T12:19:07.122 INFO:tasks.workunit.client.0.smithi160.stdout: 99 386331 282 265756 410 240408 855 2020-11-20T12:19:17.122 INFO:tasks.workunit.client.0.smithi160.stdout: 107 433317 503 300826 273 277900 883 2020-11-20T12:19:27.122 INFO:tasks.workunit.client.0.smithi160.stdout: 111 353051 202 243034 186 221331 447 2020-11-20T12:19:28.698 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:28.701 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:28.703 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:37.127 INFO:tasks.workunit.client.0.smithi160.stdout: 115 387438 437 265724 238 243220 807 2020-11-20T12:19:47.128 INFO:tasks.workunit.client.0.smithi160.stdout: 118 394942 387 270476 200 241740 864 2020-11-20T12:19:57.127 INFO:tasks.workunit.client.0.smithi160.stdout: 123 410107 352 280239 325 246551 888 2020-11-20T12:19:58.861 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:58.873 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:58.904 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:07.127 INFO:tasks.workunit.client.0.smithi160.stdout: 125 341676 147 232574 170 196218 472 2020-11-20T12:20:17.128 INFO:tasks.workunit.client.0.smithi160.stdout: 129 371658 283 253338 207 213081 695 2020-11-20T12:20:27.127 INFO:tasks.workunit.client.0.smithi160.stdout: 135 416507 402 285194 355 236899 987 2020-11-20T12:20:29.068 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:29.071 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:29.074 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:29.346 INFO:tasks.ceph.mds.a.smithi160.stderr:2020-11-20T12:20:29.343+0000 7f16a2b1b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 23913) UID: 0 2020-11-20T12:20:37.129 INFO:tasks.workunit.client.0.smithi160.stdout: 137 327330 392 228277 145 189632 752 2020-11-20T12:20:47.128 INFO:tasks.workunit.client.0.smithi160.stdout: 139 306903 279 211862 179 176447 570 2020-11-20T12:20:57.128 INFO:tasks.workunit.client.0.smithi160.stdout: 143 268245 221 186371 249 154027 711 2020-11-20T12:20:59.274 INFO:tasks.workunit.client.0.smithi160.stdout: 2020-11-20T12:20:59.275 INFO:tasks.workunit.client.0.smithi160.stdout:Final score for writes: 143 2020-11-20T12:20:59.275 INFO:tasks.workunit.client.0.smithi160.stdout:Final score for reads : 236371 2020-11-20T12:20:59.275 INFO:tasks.workunit.client.0.smithi160.stdout: 2020-11-20T12:20:59.276 INFO:teuthology.orchestra.run:Running command with timeout 3600 2020-11-20T12:20:59.276 INFO:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2020-11-20T12:22:22.283 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2020-11-20T12:22:22.321 INFO:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2020-11-20T12:22:23.422 DEBUG:teuthology.parallel:result is None 2020-11-20T12:22:23.423 INFO:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:22:23.516 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2020-11-20T12:22:23.516 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2020-11-20T12:22:23.525 DEBUG:tasks.check_counter:Getting stats from a 2020-11-20T12:22:23.528 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2020-11-20T12:22:23.757 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:23.758 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2020-11-20T12:22:23.758 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 35801, 2020-11-20T12:22:23.759 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 35802, 2020-11-20T12:22:23.759 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 9642888, 2020-11-20T12:22:23.759 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 236731581, 2020-11-20T12:22:23.760 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 8, 2020-11-20T12:22:23.760 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 2, 2020-11-20T12:22:23.760 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 8.592280231, 2020-11-20T12:22:23.761 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 2.793061884, 2020-11-20T12:22:23.761 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.974687360, 2020-11-20T12:22:23.761 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 4.433515485, 2020-11-20T12:22:23.762 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:23.762 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 35801, 2020-11-20T12:22:23.762 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 30.635906626, 2020-11-20T12:22:23.763 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000855727 2020-11-20T12:22:23.763 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.763 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:23.764 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.764 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.764 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.765 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.765 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.765 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2020-11-20T12:22:23.766 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 17820, 2020-11-20T12:22:23.766 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 17816, 2020-11-20T12:22:23.766 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 9375002, 2020-11-20T12:22:23.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 217480715, 2020-11-20T12:22:23.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2020-11-20T12:22:23.767 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2020-11-20T12:22:23.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 5.576347790, 2020-11-20T12:22:23.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 2.079080635, 2020-11-20T12:22:23.768 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.544713593, 2020-11-20T12:22:23.769 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 2.733706056, 2020-11-20T12:22:23.769 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:23.769 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 17816, 2020-11-20T12:22:23.770 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 12.969703237, 2020-11-20T12:22:23.770 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000727980 2020-11-20T12:22:23.770 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.771 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:23.771 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.772 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.772 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.772 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.773 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.773 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2020-11-20T12:22:23.774 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 221353, 2020-11-20T12:22:23.774 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 419148, 2020-11-20T12:22:23.774 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 63315780, 2020-11-20T12:22:23.775 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 252800896, 2020-11-20T12:22:23.775 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 6, 2020-11-20T12:22:23.775 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2020-11-20T12:22:23.775 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 46.168959645, 2020-11-20T12:22:23.776 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 34.258668472, 2020-11-20T12:22:23.776 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 357.305459881, 2020-11-20T12:22:23.776 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 2.574416342, 2020-11-20T12:22:23.777 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:23.777 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 419147, 2020-11-20T12:22:23.778 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 239.377079985, 2020-11-20T12:22:23.778 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000571105 2020-11-20T12:22:23.778 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.778 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:23.779 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 261279, 2020-11-20T12:22:23.779 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.523975134, 2020-11-20T12:22:23.779 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000002005 2020-11-20T12:22:23.780 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.780 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.780 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2020-11-20T12:22:23.781 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2020-11-20T12:22:23.781 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2020-11-20T12:22:23.781 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.782 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2020-11-20T12:22:23.782 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2020-11-20T12:22:23.782 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2020-11-20T12:22:23.783 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3188, 2020-11-20T12:22:23.783 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 179.339570019, 2020-11-20T12:22:23.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.056254570 2020-11-20T12:22:23.784 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.785 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2020-11-20T12:22:23.785 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2020-11-20T12:22:23.786 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2020-11-20T12:22:23.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 40717, 2020-11-20T12:22:23.786 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 30.199990004, 2020-11-20T12:22:23.787 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000741704 2020-11-20T12:22:23.787 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.788 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.788 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2020-11-20T12:22:23.789 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 125430, 2020-11-20T12:22:23.789 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 125430, 2020-11-20T12:22:23.789 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2020-11-20T12:22:23.790 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 125430, 2020-11-20T12:22:23.790 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 3506.232268402, 2020-11-20T12:22:23.790 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.027953697 2020-11-20T12:22:23.791 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.791 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2020-11-20T12:22:23.791 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch": 0, 2020-11-20T12:22:23.792 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 1765, 2020-11-20T12:22:23.792 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 135, 2020-11-20T12:22:23.792 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 8, 2020-11-20T12:22:23.793 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 16, 2020-11-20T12:22:23.793 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 0, 2020-11-20T12:22:23.794 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 16, 2020-11-20T12:22:23.794 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 0, 2020-11-20T12:22:23.794 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 16, 2020-11-20T12:22:23.794 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 30658, 2020-11-20T12:22:23.795 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 7, 2020-11-20T12:22:23.795 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 7, 2020-11-20T12:22:23.795 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 2, 2020-11-20T12:22:23.795 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 173700, 2020-11-20T12:22:23.796 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 167272, 2020-11-20T12:22:23.796 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2020-11-20T12:22:23.796 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2020-11-20T12:22:23.797 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2020-11-20T12:22:23.797 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2020-11-20T12:22:23.797 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 1, 2020-11-20T12:22:23.798 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 84263, 2020-11-20T12:22:23.798 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2020-11-20T12:22:23.798 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2020-11-20T12:22:23.799 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2020-11-20T12:22:23.799 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2020-11-20T12:22:23.799 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2020-11-20T12:22:23.800 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2020-11-20T12:22:23.800 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2020-11-20T12:22:23.800 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2020-11-20T12:22:23.801 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 185, 2020-11-20T12:22:23.801 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 4734405, 2020-11-20T12:22:23.801 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2020-11-20T12:22:23.802 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2020-11-20T12:22:23.802 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 29420, 2020-11-20T12:22:23.802 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 98909, 2020-11-20T12:22:23.802 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 5, 2020-11-20T12:22:23.803 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2020-11-20T12:22:23.803 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2020-11-20T12:22:23.803 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 83654, 2020-11-20T12:22:23.804 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 44287, 2020-11-20T12:22:23.804 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 4585, 2020-11-20T12:22:23.804 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 89383 2020-11-20T12:22:23.805 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.805 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2020-11-20T12:22:23.805 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 6, 2020-11-20T12:22:23.806 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2020-11-20T12:22:23.806 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2020-11-20T12:22:23.806 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 44312, 2020-11-20T12:22:23.807 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 44306, 2020-11-20T12:22:23.807 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2020-11-20T12:22:23.807 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2020-11-20T12:22:23.808 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2020-11-20T12:22:23.808 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2020-11-20T12:22:23.808 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2020-11-20T12:22:23.809 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2020-11-20T12:22:23.809 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2020-11-20T12:22:23.809 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2020-11-20T12:22:23.810 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2020-11-20T12:22:23.810 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2020-11-20T12:22:23.810 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 143, 2020-11-20T12:22:23.811 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2020-11-20T12:22:23.811 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2020-11-20T12:22:23.811 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.812 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2020-11-20T12:22:23.812 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 221164, 2020-11-20T12:22:23.812 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 120852, 2020-11-20T12:22:23.813 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 120852, 2020-11-20T12:22:23.813 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 100312, 2020-11-20T12:22:23.814 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2020-11-20T12:22:23.814 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 4224, 2020-11-20T12:22:23.814 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 270, 2020-11-20T12:22:23.815 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 142, 2020-11-20T12:22:23.815 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 142, 2020-11-20T12:22:23.815 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 133, 2020-11-20T12:22:23.815 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2020-11-20T12:22:23.816 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 5, 2020-11-20T12:22:23.816 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 293603434, 2020-11-20T12:22:23.816 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 498524365, 2020-11-20T12:22:23.817 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2020-11-20T12:22:23.817 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2020-11-20T12:22:23.818 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1520, 2020-11-20T12:22:23.818 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 115.567883645, 2020-11-20T12:22:23.818 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.076031502 2020-11-20T12:22:23.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.819 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2020-11-20T12:22:23.819 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.820 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2020-11-20T12:22:23.820 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 19, 2020-11-20T12:22:23.820 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 44325, 2020-11-20T12:22:23.821 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 44306, 2020-11-20T12:22:23.821 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 15, 2020-11-20T12:22:23.821 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 1258, 2020-11-20T12:22:23.822 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 1243, 2020-11-20T12:22:23.822 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 99, 2020-11-20T12:22:23.822 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 104700, 2020-11-20T12:22:23.823 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 104601, 2020-11-20T12:22:23.823 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 7, 2020-11-20T12:22:23.823 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 44314, 2020-11-20T12:22:23.824 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 44307, 2020-11-20T12:22:23.824 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 157276, 2020-11-20T12:22:23.824 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 340188 2020-11-20T12:22:23.825 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.825 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2020-11-20T12:22:23.825 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 127603, 2020-11-20T12:22:23.826 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2020-11-20T12:22:23.826 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 125430, 2020-11-20T12:22:23.826 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 6, 2020-11-20T12:22:23.826 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2020-11-20T12:22:23.827 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2020-11-20T12:22:23.827 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 44151, 2020-11-20T12:22:23.827 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 950.126691914, 2020-11-20T12:22:23.828 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.021519935 2020-11-20T12:22:23.828 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.828 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2020-11-20T12:22:23.829 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2570, 2020-11-20T12:22:23.829 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1228.107237441, 2020-11-20T12:22:23.829 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.477862738 2020-11-20T12:22:23.830 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.830 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2020-11-20T12:22:23.830 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.831 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.831 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.831 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.832 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2020-11-20T12:22:23.832 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.832 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.833 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.833 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.833 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2020-11-20T12:22:23.834 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1819, 2020-11-20T12:22:23.834 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2.370274440, 2020-11-20T12:22:23.834 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001303064 2020-11-20T12:22:23.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.835 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2020-11-20T12:22:23.835 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.836 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.836 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.836 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.837 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2020-11-20T12:22:23.837 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.838 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.838 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.838 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.839 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2020-11-20T12:22:23.839 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.839 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.840 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.840 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.840 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2020-11-20T12:22:23.840 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.841 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.841 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.841 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.842 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2020-11-20T12:22:23.842 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.842 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.843 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.843 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.843 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2020-11-20T12:22:23.844 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.844 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.844 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.845 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.845 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2020-11-20T12:22:23.845 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 158, 2020-11-20T12:22:23.846 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 6.616394252, 2020-11-20T12:22:23.846 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.041875912 2020-11-20T12:22:23.846 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.847 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2020-11-20T12:22:23.847 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.847 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.848 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.848 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.848 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2020-11-20T12:22:23.849 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.849 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.849 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.850 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.850 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2020-11-20T12:22:23.850 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6124, 2020-11-20T12:22:23.851 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 140.087143710, 2020-11-20T12:22:23.851 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.022875105 2020-11-20T12:22:23.851 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.852 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2020-11-20T12:22:23.852 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1132, 2020-11-20T12:22:23.852 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 3.336122899, 2020-11-20T12:22:23.852 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002947105 2020-11-20T12:22:23.853 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.853 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2020-11-20T12:22:23.853 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 43761, 2020-11-20T12:22:23.854 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1105.857220288, 2020-11-20T12:22:23.854 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.025270382 2020-11-20T12:22:23.854 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.855 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2020-11-20T12:22:23.855 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.855 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.856 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.856 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2020-11-20T12:22:23.857 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 158, 2020-11-20T12:22:23.857 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 21.594052316, 2020-11-20T12:22:23.857 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.136671217 2020-11-20T12:22:23.858 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.858 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2020-11-20T12:22:23.858 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.859 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.859 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.859 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.860 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2020-11-20T12:22:23.860 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.860 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.861 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.861 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2020-11-20T12:22:23.862 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6, 2020-11-20T12:22:23.862 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.047814881, 2020-11-20T12:22:23.862 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.007969146 2020-11-20T12:22:23.862 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.863 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2020-11-20T12:22:23.863 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.863 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.864 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.864 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.864 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2020-11-20T12:22:23.865 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.865 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.865 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.866 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.866 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2020-11-20T12:22:23.866 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.867 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.867 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.867 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.868 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2020-11-20T12:22:23.868 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.868 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.869 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.869 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.869 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2020-11-20T12:22:23.870 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3, 2020-11-20T12:22:23.870 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.003093648, 2020-11-20T12:22:23.870 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001031216 2020-11-20T12:22:23.871 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.871 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2020-11-20T12:22:23.871 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 25548, 2020-11-20T12:22:23.871 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 48.086222613, 2020-11-20T12:22:23.872 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001882191 2020-11-20T12:22:23.872 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.872 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2020-11-20T12:22:23.873 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0 2020-11-20T12:22:23.873 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.873 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2020-11-20T12:22:23.874 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 1, 2020-11-20T12:22:23.874 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 1, 2020-11-20T12:22:23.874 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 0, 2020-11-20T12:22:23.875 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 1, 2020-11-20T12:22:23.875 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2020-11-20T12:22:23.875 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 27299, 2020-11-20T12:22:23.876 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 27299, 2020-11-20T12:22:23.876 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 462 2020-11-20T12:22:23.876 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.877 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2020-11-20T12:22:23.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 7680, 2020-11-20T12:22:23.877 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 7680, 2020-11-20T12:22:23.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2020-11-20T12:22:23.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2020-11-20T12:22:23.878 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2020-11-20T12:22:23.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2020-11-20T12:22:23.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2020-11-20T12:22:23.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2020-11-20T12:22:23.879 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2020-11-20T12:22:23.880 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2020-11-20T12:22:23.880 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2020-11-20T12:22:23.880 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2020-11-20T12:22:23.881 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_Buffer_bytes": 0, 2020-11-20T12:22:23.881 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_Buffer_items": 0, 2020-11-20T12:22:23.881 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_Extent_bytes": 0, 2020-11-20T12:22:23.882 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_Extent_items": 0, 2020-11-20T12:22:23.882 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_Blob_bytes": 0, 2020-11-20T12:22:23.882 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_Blob_items": 0, 2020-11-20T12:22:23.883 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_SharedBlob_bytes": 0, 2020-11-20T12:22:23.883 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_SharedBlob_items": 0, 2020-11-20T12:22:23.883 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2020-11-20T12:22:23.884 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2020-11-20T12:22:23.884 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2020-11-20T12:22:23.884 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2020-11-20T12:22:23.885 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2020-11-20T12:22:23.885 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2020-11-20T12:22:23.885 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2020-11-20T12:22:23.886 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2020-11-20T12:22:23.886 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2020-11-20T12:22:23.886 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2020-11-20T12:22:23.887 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2020-11-20T12:22:23.887 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2020-11-20T12:22:23.887 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2020-11-20T12:22:23.888 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2020-11-20T12:22:23.888 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2020-11-20T12:22:23.889 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2020-11-20T12:22:23.889 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 850505, 2020-11-20T12:22:23.889 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 1528, 2020-11-20T12:22:23.890 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 88, 2020-11-20T12:22:23.890 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 1, 2020-11-20T12:22:23.890 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2020-11-20T12:22:23.891 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2020-11-20T12:22:23.891 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2020-11-20T12:22:23.891 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2020-11-20T12:22:23.892 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2020-11-20T12:22:23.892 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2020-11-20T12:22:23.892 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 6584, 2020-11-20T12:22:23.893 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 114, 2020-11-20T12:22:23.893 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2020-11-20T12:22:23.893 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2020-11-20T12:22:23.894 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2020-11-20T12:22:23.894 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2020-11-20T12:22:23.894 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 4353719, 2020-11-20T12:22:23.895 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 71304, 2020-11-20T12:22:23.895 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2020-11-20T12:22:23.895 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2020-11-20T12:22:23.896 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2020-11-20T12:22:23.896 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2020-11-20T12:22:23.896 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.897 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2020-11-20T12:22:23.897 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2020-11-20T12:22:23.897 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2020-11-20T12:22:23.898 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 60892, 2020-11-20T12:22:23.898 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 534822089, 2020-11-20T12:22:23.898 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 30, 2020-11-20T12:22:23.899 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 60892, 2020-11-20T12:22:23.899 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2020-11-20T12:22:23.900 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 60892, 2020-11-20T12:22:23.900 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 83703 2020-11-20T12:22:23.900 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.900 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 60892, 2020-11-20T12:22:23.901 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 791, 2020-11-20T12:22:23.901 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 60101, 2020-11-20T12:22:23.901 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2020-11-20T12:22:23.902 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2020-11-20T12:22:23.902 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 525, 2020-11-20T12:22:23.902 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 9853, 2020-11-20T12:22:23.903 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 791, 2020-11-20T12:22:23.903 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 2311, 2020-11-20T12:22:23.903 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 355, 2020-11-20T12:22:23.904 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2020-11-20T12:22:23.904 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2020-11-20T12:22:23.904 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2020-11-20T12:22:23.905 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 135, 2020-11-20T12:22:23.905 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 45587, 2020-11-20T12:22:23.905 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2020-11-20T12:22:23.906 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2020-11-20T12:22:23.906 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2020-11-20T12:22:23.906 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 0, 2020-11-20T12:22:23.907 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 19706, 2020-11-20T12:22:23.907 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2020-11-20T12:22:23.907 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2020-11-20T12:22:23.908 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2020-11-20T12:22:23.908 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2020-11-20T12:22:23.908 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2020-11-20T12:22:23.909 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2020-11-20T12:22:23.909 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2020-11-20T12:22:23.909 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2020-11-20T12:22:23.910 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2020-11-20T12:22:23.910 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 5, 2020-11-20T12:22:23.910 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2020-11-20T12:22:23.911 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2020-11-20T12:22:23.911 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2020-11-20T12:22:23.911 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2020-11-20T12:22:23.911 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2020-11-20T12:22:23.912 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2020-11-20T12:22:23.912 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2020-11-20T12:22:23.912 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2020-11-20T12:22:23.913 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2020-11-20T12:22:23.913 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2020-11-20T12:22:23.913 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2020-11-20T12:22:23.914 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2020-11-20T12:22:23.914 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2020-11-20T12:22:23.914 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2020-11-20T12:22:23.915 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2020-11-20T12:22:23.915 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2020-11-20T12:22:23.915 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 26, 2020-11-20T12:22:23.916 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2020-11-20T12:22:23.916 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 1, 2020-11-20T12:22:23.916 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 9, 2020-11-20T12:22:23.917 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 9, 2020-11-20T12:22:23.917 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2020-11-20T12:22:23.917 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2020-11-20T12:22:23.918 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 3689, 2020-11-20T12:22:23.918 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 0, 2020-11-20T12:22:23.918 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 746 2020-11-20T12:22:23.919 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.919 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2020-11-20T12:22:23.919 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2020-11-20T12:22:23.920 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2020-11-20T12:22:23.920 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2020-11-20T12:22:23.920 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2020-11-20T12:22:23.921 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.921 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2020-11-20T12:22:23.921 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2020-11-20T12:22:23.922 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 12, 2020-11-20T12:22:23.922 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2020-11-20T12:22:23.922 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 4, 2020-11-20T12:22:23.923 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 44306, 2020-11-20T12:22:23.923 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2020-11-20T12:22:23.923 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.924 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-11-20T12:22:23.924 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2020-11-20T12:22:23.924 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2020-11-20T12:22:23.925 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2020-11-20T12:22:23.925 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 274969, 2020-11-20T12:22:23.925 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 60998775, 2020-11-20T12:22:23.926 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2020-11-20T12:22:23.926 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 274969, 2020-11-20T12:22:23.926 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2020-11-20T12:22:23.927 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2020-11-20T12:22:23.927 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 274969, 2020-11-20T12:22:23.927 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 60998775, 2020-11-20T12:22:23.928 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2020-11-20T12:22:23.928 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.928 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.928 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.929 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.929 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.929 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2020-11-20T12:22:23.929 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2020-11-20T12:22:23.930 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2020-11-20T12:22:23.930 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2020-11-20T12:22:23.931 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2020-11-20T12:22:23.931 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2020-11-20T12:22:23.931 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2020-11-20T12:22:23.932 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2020-11-20T12:22:23.932 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 60892, 2020-11-20T12:22:23.932 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 539298059, 2020-11-20T12:22:23.933 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 15165, 2020-11-20T12:22:23.933 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 539298059, 2020-11-20T12:22:23.933 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2020-11-20T12:22:23.934 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.934 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.934 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.935 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.935 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.935 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2020-11-20T12:22:23.936 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2020-11-20T12:22:23.936 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2020-11-20T12:22:23.936 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2020-11-20T12:22:23.937 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2020-11-20T12:22:23.937 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2020-11-20T12:22:23.937 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2020-11-20T12:22:23.938 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2020-11-20T12:22:23.938 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 60892, 2020-11-20T12:22:23.938 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 60892, 2020-11-20T12:22:23.939 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 60892, 2020-11-20T12:22:23.939 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 60892, 2020-11-20T12:22:23.939 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2020-11-20T12:22:23.939 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.940 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.940 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.940 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.941 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.941 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2020-11-20T12:22:23.941 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2020-11-20T12:22:23.942 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2020-11-20T12:22:23.942 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2020-11-20T12:22:23.942 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 44306, 2020-11-20T12:22:23.943 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 4475970, 2020-11-20T12:22:23.943 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2020-11-20T12:22:23.943 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 44306, 2020-11-20T12:22:23.944 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2020-11-20T12:22:23.944 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2020-11-20T12:22:23.944 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 791, 2020-11-20T12:22:23.945 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 4475970, 2020-11-20T12:22:23.945 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2020-11-20T12:22:23.945 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.946 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.946 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.946 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.947 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2020-11-20T12:22:23.947 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x564f1c2b7f40": { 2020-11-20T12:22:23.947 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 4526, 2020-11-20T12:22:23.948 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2020-11-20T12:22:23.948 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2020-11-20T12:22:23.948 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 221164, 2020-11-20T12:22:23.949 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 494330061, 2020-11-20T12:22:23.949 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2020-11-20T12:22:23.949 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 221164, 2020-11-20T12:22:23.950 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2020-11-20T12:22:23.950 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2020-11-20T12:22:23.950 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 1520, 2020-11-20T12:22:23.950 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 494325535, 2020-11-20T12:22:23.951 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2020-11-20T12:22:23.951 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2020-11-20T12:22:23.951 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2020-11-20T12:22:23.952 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2020-11-20T12:22:23.952 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.952 INFO:teuthology.orchestra.run.smithi160.stdout: } 2020-11-20T12:22:23.953 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:23.955 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=135 2020-11-20T12:22:23.955 DEBUG:tasks.check_counter:Getting stats from b 2020-11-20T12:22:23.956 INFO:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2020-11-20T12:22:24.103 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2020-11-20T12:22:24.103 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2020-11-20T12:22:24.103 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 132, 2020-11-20T12:22:24.104 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 131, 2020-11-20T12:22:24.104 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 138288, 2020-11-20T12:22:24.104 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 71564, 2020-11-20T12:22:24.104 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 4, 2020-11-20T12:22:24.104 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 18446744073709551615, 2020-11-20T12:22:24.105 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.019082427, 2020-11-20T12:22:24.105 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.007086064, 2020-11-20T12:22:24.105 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.006116295, 2020-11-20T12:22:24.105 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.003063464, 2020-11-20T12:22:24.105 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 131, 2020-11-20T12:22:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.006531285, 2020-11-20T12:22:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000049857 2020-11-20T12:22:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.106 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2020-11-20T12:22:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: } 2020-11-20T12:22:24.107 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2020-11-20T12:22:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 2, 2020-11-20T12:22:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 103, 2020-11-20T12:22:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 267, 2020-11-20T12:22:24.108 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 84028, 2020-11-20T12:22:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 3, 2020-11-20T12:22:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 0, 2020-11-20T12:22:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.007349482, 2020-11-20T12:22:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.005217226, 2020-11-20T12:22:24.109 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.000945506, 2020-11-20T12:22:24.110 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T12:22:24.110 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:24.110 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 102, 2020-11-20T12:22:24.110 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.006166106, 2020-11-20T12:22:24.110 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000060452 2020-11-20T12:22:24.111 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.111 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:24.111 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2020-11-20T12:22:24.111 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.111 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.112 INFO:teuthology.orchestra.run.smithi150.stdout: } 2020-11-20T12:22:24.112 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.112 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2020-11-20T12:22:24.112 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 4, 2020-11-20T12:22:24.112 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 4, 2020-11-20T12:22:24.113 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 1568, 2020-11-20T12:22:24.113 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 448, 2020-11-20T12:22:24.113 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 2, 2020-11-20T12:22:24.113 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 18446744073709551615, 2020-11-20T12:22:24.113 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.000805892, 2020-11-20T12:22:24.114 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.000036475, 2020-11-20T12:22:24.114 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.000744136, 2020-11-20T12:22:24.114 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T12:22:24.114 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:24.114 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3, 2020-11-20T12:22:24.115 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000766441, 2020-11-20T12:22:24.115 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000255480 2020-11-20T12:22:24.115 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.115 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:24.115 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2020-11-20T12:22:24.115 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.116 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.116 INFO:teuthology.orchestra.run.smithi150.stdout: } 2020-11-20T12:22:24.116 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.116 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2020-11-20T12:22:24.116 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 0, 2020-11-20T12:22:24.117 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2020-11-20T12:22:24.117 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.117 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2020-11-20T12:22:24.117 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2020-11-20T12:22:24.117 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2020-11-20T12:22:24.118 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2020-11-20T12:22:24.118 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2020-11-20T12:22:24.118 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2020-11-20T12:22:24.118 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2020-11-20T12:22:24.118 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2020-11-20T12:22:24.119 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2020-11-20T12:22:24.119 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2020-11-20T12:22:24.119 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2020-11-20T12:22:24.119 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2020-11-20T12:22:24.119 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2020-11-20T12:22:24.120 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_Buffer_bytes": 0, 2020-11-20T12:22:24.120 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_Buffer_items": 0, 2020-11-20T12:22:24.120 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_Extent_bytes": 0, 2020-11-20T12:22:24.120 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_Extent_items": 0, 2020-11-20T12:22:24.120 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_Blob_bytes": 0, 2020-11-20T12:22:24.121 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_Blob_items": 0, 2020-11-20T12:22:24.121 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_SharedBlob_bytes": 0, 2020-11-20T12:22:24.121 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_SharedBlob_items": 0, 2020-11-20T12:22:24.121 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2020-11-20T12:22:24.122 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2020-11-20T12:22:24.122 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2020-11-20T12:22:24.122 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2020-11-20T12:22:24.122 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2020-11-20T12:22:24.122 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2020-11-20T12:22:24.123 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2020-11-20T12:22:24.123 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2020-11-20T12:22:24.123 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2020-11-20T12:22:24.123 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2020-11-20T12:22:24.123 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2020-11-20T12:22:24.124 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2020-11-20T12:22:24.124 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2020-11-20T12:22:24.124 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2020-11-20T12:22:24.124 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2020-11-20T12:22:24.124 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2020-11-20T12:22:24.125 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 90852, 2020-11-20T12:22:24.125 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 39, 2020-11-20T12:22:24.125 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2020-11-20T12:22:24.125 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2020-11-20T12:22:24.125 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2020-11-20T12:22:24.126 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2020-11-20T12:22:24.126 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2020-11-20T12:22:24.126 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2020-11-20T12:22:24.126 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2020-11-20T12:22:24.126 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2020-11-20T12:22:24.127 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 0, 2020-11-20T12:22:24.127 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 0, 2020-11-20T12:22:24.127 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2020-11-20T12:22:24.127 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2020-11-20T12:22:24.127 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2020-11-20T12:22:24.128 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2020-11-20T12:22:24.128 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 848, 2020-11-20T12:22:24.128 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 2, 2020-11-20T12:22:24.128 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2020-11-20T12:22:24.128 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2020-11-20T12:22:24.129 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2020-11-20T12:22:24.129 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2020-11-20T12:22:24.129 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2020-11-20T12:22:24.129 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-11-20T12:22:24.129 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2020-11-20T12:22:24.130 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2020-11-20T12:22:24.130 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2020-11-20T12:22:24.130 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 133, 2020-11-20T12:22:24.130 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 119632, 2020-11-20T12:22:24.130 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2020-11-20T12:22:24.131 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 133, 2020-11-20T12:22:24.131 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2020-11-20T12:22:24.131 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2020-11-20T12:22:24.131 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 133, 2020-11-20T12:22:24.131 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 119632, 2020-11-20T12:22:24.132 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2020-11-20T12:22:24.132 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2020-11-20T12:22:24.132 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.132 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.133 INFO:teuthology.orchestra.run.smithi150.stdout: } 2020-11-20T12:22:24.133 INFO:teuthology.orchestra.run.smithi150.stdout: } 2020-11-20T12:22:24.133 INFO:teuthology.orchestra.run.smithi150.stdout:} 2020-11-20T12:22:24.134 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2020-11-20T12:22:24.134 DEBUG:tasks.check_counter:Getting stats from c 2020-11-20T12:22:24.135 INFO:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok perf dump 2020-11-20T12:22:24.265 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2020-11-20T12:22:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2020-11-20T12:22:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 136, 2020-11-20T12:22:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 133, 2020-11-20T12:22:24.266 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 139986, 2020-11-20T12:22:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 71705, 2020-11-20T12:22:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2020-11-20T12:22:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 0, 2020-11-20T12:22:24.267 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.018281871, 2020-11-20T12:22:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.007147795, 2020-11-20T12:22:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.005932535, 2020-11-20T12:22:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.002581098, 2020-11-20T12:22:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 132, 2020-11-20T12:22:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.006488196, 2020-11-20T12:22:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000049153 2020-11-20T12:22:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.269 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2020-11-20T12:22:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2020-11-20T12:22:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2020-11-20T12:22:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 4, 2020-11-20T12:22:24.271 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 107, 2020-11-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1218, 2020-11-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 84406, 2020-11-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2020-11-20T12:22:24.272 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2020-11-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.006060530, 2020-11-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.003825622, 2020-11-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.001096802, 2020-11-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T12:22:24.273 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 105, 2020-11-20T12:22:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.005812697, 2020-11-20T12:22:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000055359 2020-11-20T12:22:24.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2020-11-20T12:22:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2020-11-20T12:22:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2020-11-20T12:22:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 4, 2020-11-20T12:22:24.276 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 5, 2020-11-20T12:22:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1568, 2020-11-20T12:22:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 448, 2020-11-20T12:22:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 3, 2020-11-20T12:22:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 18446744073709551615, 2020-11-20T12:22:24.277 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.000853457, 2020-11-20T12:22:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.000034362, 2020-11-20T12:22:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.000812208, 2020-11-20T12:22:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2020-11-20T12:22:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2020-11-20T12:22:24.278 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3, 2020-11-20T12:22:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000813593, 2020-11-20T12:22:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000271197 2020-11-20T12:22:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2020-11-20T12:22:24.279 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2020-11-20T12:22:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2020-11-20T12:22:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.280 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2020-11-20T12:22:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 0, 2020-11-20T12:22:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2020-11-20T12:22:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2020-11-20T12:22:24.281 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2020-11-20T12:22:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2020-11-20T12:22:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2020-11-20T12:22:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2020-11-20T12:22:24.282 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2020-11-20T12:22:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2020-11-20T12:22:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2020-11-20T12:22:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2020-11-20T12:22:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2020-11-20T12:22:24.283 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2020-11-20T12:22:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2020-11-20T12:22:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2020-11-20T12:22:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_Buffer_bytes": 0, 2020-11-20T12:22:24.284 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_Buffer_items": 0, 2020-11-20T12:22:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_Extent_bytes": 0, 2020-11-20T12:22:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_Extent_items": 0, 2020-11-20T12:22:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_Blob_bytes": 0, 2020-11-20T12:22:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_Blob_items": 0, 2020-11-20T12:22:24.285 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_SharedBlob_bytes": 0, 2020-11-20T12:22:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_SharedBlob_items": 0, 2020-11-20T12:22:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2020-11-20T12:22:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2020-11-20T12:22:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2020-11-20T12:22:24.286 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2020-11-20T12:22:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2020-11-20T12:22:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2020-11-20T12:22:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2020-11-20T12:22:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2020-11-20T12:22:24.287 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2020-11-20T12:22:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2020-11-20T12:22:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2020-11-20T12:22:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2020-11-20T12:22:24.288 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2020-11-20T12:22:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2020-11-20T12:22:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2020-11-20T12:22:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2020-11-20T12:22:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 90869, 2020-11-20T12:22:24.289 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 40, 2020-11-20T12:22:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2020-11-20T12:22:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2020-11-20T12:22:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2020-11-20T12:22:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2020-11-20T12:22:24.290 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2020-11-20T12:22:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2020-11-20T12:22:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2020-11-20T12:22:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2020-11-20T12:22:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 0, 2020-11-20T12:22:24.291 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 0, 2020-11-20T12:22:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2020-11-20T12:22:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2020-11-20T12:22:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2020-11-20T12:22:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2020-11-20T12:22:24.292 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 848, 2020-11-20T12:22:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 2, 2020-11-20T12:22:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2020-11-20T12:22:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2020-11-20T12:22:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2020-11-20T12:22:24.293 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2020-11-20T12:22:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2020-11-20T12:22:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2020-11-20T12:22:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2020-11-20T12:22:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2020-11-20T12:22:24.294 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2020-11-20T12:22:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 134, 2020-11-20T12:22:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 120139, 2020-11-20T12:22:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2020-11-20T12:22:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 134, 2020-11-20T12:22:24.295 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2020-11-20T12:22:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2020-11-20T12:22:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 134, 2020-11-20T12:22:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 120139, 2020-11-20T12:22:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2020-11-20T12:22:24.296 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2020-11-20T12:22:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2020-11-20T12:22:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2020-11-20T12:22:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2020-11-20T12:22:24.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2020-11-20T12:22:24.297 INFO:teuthology.orchestra.run.smithi134.stdout:} 2020-11-20T12:22:24.299 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2020-11-20T12:22:24.299 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2020-11-20T12:22:24.315 INFO:tasks.kclient:Unmounting kernel clients... 2020-11-20T12:22:24.315 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2020-11-20T12:22:24.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-11-20T12:22:24.316 INFO:teuthology.orchestra.run.smithi160:> sudo umount /home/ubuntu/cephtest/mnt.0 2020-11-20T12:22:24.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:22:24.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:22:24.466 INFO:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-11-20T12:22:24.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:22:24.530 INFO:teuthology.orchestra.run.smithi160:> ip netns list 2020-11-20T12:22:24.639 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2020-11-20T12:22:24.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:22:24.644 INFO:teuthology.orchestra.run.smithi160:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T12:22:24.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:22:24.792 INFO:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2020-11-20T12:22:25.003 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2020-11-20T12:22:25.016 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2020-11-20T12:22:25.017 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:22:25.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.225+0000 7f04d0d85700 1 Processor -- start 2020-11-20T12:22:25.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.225+0000 7f04d0d85700 1 -- start start 2020-11-20T12:22:25.230 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.226+0000 7f04d0d85700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc063d10 con 0x7f04cc14e7f0 2020-11-20T12:22:25.230 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.226+0000 7f04d0d85700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc1519a0 con 0x7f04cc0bc620 2020-11-20T12:22:25.230 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.226+0000 7f04d0d85700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc151c40 con 0x7f04cc067190 2020-11-20T12:22:25.230 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04cb7fe700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f04cc0bc620 0x7f04cc1510d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47408/0 (socket says 172.21.15.160:47408) 2020-11-20T12:22:25.231 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04cb7fe700 1 -- 172.21.15.160:0/3638539204 learned_addr learned my addr 172.21.15.160:0/3638539204 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:25.233 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662835271 0 0) 0x7f04cc1519a0 con 0x7f04cc0bc620 2020-11-20T12:22:25.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b8003240 con 0x7f04cc0bc620 2020-11-20T12:22:25.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180489804 0 0) 0x7f04cc063d10 con 0x7f04cc14e7f0 2020-11-20T12:22:25.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04cc1519a0 con 0x7f04cc14e7f0 2020-11-20T12:22:25.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510603420 0 0) 0x7f04cc151c40 con 0x7f04cc067190 2020-11-20T12:22:25.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.227+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04cc063d10 con 0x7f04cc067190 2020-11-20T12:22:25.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.1 v1:172.21.15.150:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3725237088 0 0) 0x7f04b8003240 con 0x7f04cc0bc620 2020-11-20T12:22:25.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 >> v1:172.21.15.160:6789/0 conn(0x7f04cc067190 legacy=0x7f04cc14cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 >> v1:172.21.15.134:6789/0 conn(0x7f04cc14e7f0 legacy=0x7f04cc14efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 --> v1:172.21.15.150:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc151ee0 con 0x7f04cc0bc620 2020-11-20T12:22:25.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.1 v1:172.21.15.150:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f04bc0014e0 con 0x7f04cc0bc620 2020-11-20T12:22:25.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 >> v1:172.21.15.150:6789/0 conn(0x7f04cc0bc620 legacy=0x7f04cc1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b8004b80 0x7f04b8004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8003520 0x7f04b80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b8003f80 0x7f04b800d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b800df00 con 0x7f04b8003520 2020-11-20T12:22:25.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b800e070 con 0x7f04b8003f80 2020-11-20T12:22:25.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b800e230 con 0x7f04b8004b80 2020-11-20T12:22:25.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04cb7fe700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b8004b80 0x7f04b8004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04caffd700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8003520 0x7f04b80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.228+0000 7f04cbfff700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b8003f80 0x7f04b800d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04cb7fe700 1 -- 172.21.15.160:0/3638539204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b8003f80 msgr2=0x7f04b800d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:25.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04cb7fe700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04b8003f80 0x7f04b800d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04cb7fe700 1 -- 172.21.15.160:0/3638539204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8003520 msgr2=0x7f04b80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:25.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04cb7fe700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8003520 0x7f04b80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04cb7fe700 1 -- 172.21.15.160:0/3638539204 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8003240 con 0x7f04b8004b80 2020-11-20T12:22:25.239 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04cbfff700 1 -- 172.21.15.160:0/3638539204 reap_dead start 2020-11-20T12:22:25.239 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04cb7fe700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b8004b80 0x7f04b8004f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f04bc00c1e0 tx=0x7f04cc152070).ready entity=mon.2 client_cookie=a17387e2c9f0e1c5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:25.239 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00ce30 con 0x7f04b8004b80 2020-11-20T12:22:25.239 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc0070d0 con 0x7f04b8004b80 2020-11-20T12:22:25.239 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.229+0000 7f04ca7fc700 1 -- 172.21.15.160:0/3638539204 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc007470 con 0x7f04b8004b80 2020-11-20T12:22:25.240 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.230+0000 7f04d0d85700 1 -- 172.21.15.160:0/3638539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b8004b80 msgr2=0x7f04b8004f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.241 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.230+0000 7f04d0d85700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b8004b80 0x7f04b8004f60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f04bc00c1e0 tx=0x7f04cc152070).stop 2020-11-20T12:22:25.241 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.230+0000 7f04d0d85700 1 -- 172.21.15.160:0/3638539204 shutdown_connections 2020-11-20T12:22:25.241 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.230+0000 7f04d0d85700 1 --2- 172.21.15.160:0/3638539204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04b8004b80 0x7f04b8004f60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.241 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.230+0000 7f04d0d85700 1 -- 172.21.15.160:0/3638539204 >> 172.21.15.160:0/3638539204 conn(0x7f04cc062ef0 msgr2=0x7f04cc063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:25.242 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.230+0000 7f04d0d85700 1 -- 172.21.15.160:0/3638539204 shutdown_connections 2020-11-20T12:22:25.242 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.230+0000 7f04d0d85700 1 -- 172.21.15.160:0/3638539204 wait complete. 2020-11-20T12:22:25.244 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.231+0000 7f04d0d85700 1 Processor -- start 2020-11-20T12:22:25.244 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.231+0000 7f04d0d85700 1 -- start start 2020-11-20T12:22:25.245 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.232+0000 7f04d0d85700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8004b80 0x7f04cc142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.245 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.232+0000 7f04d0d85700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04cc1443e0 0x7f04cc14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.245 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.232+0000 7f04d0d85700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04cc144840 0x7f04cc1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.245 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.232+0000 7f04d0d85700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc14b3c0 con 0x7f04b8004b80 2020-11-20T12:22:25.246 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.232+0000 7f04d0d85700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc1534b0 con 0x7f04cc1443e0 2020-11-20T12:22:25.246 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.232+0000 7f04d0d85700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc153750 con 0x7f04cc144840 2020-11-20T12:22:25.246 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8004b80 0x7f04cc142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.246 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8004b80 0x7f04cc142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:32866/0 (socket says 172.21.15.160:32866) 2020-11-20T12:22:25.247 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 -- 172.21.15.160:0/2627660774 learned_addr learned my addr 172.21.15.160:0/2627660774 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:25.247 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04caffd700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04cc1443e0 0x7f04cc14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.247 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cbfff700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04cc144840 0x7f04cc1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.247 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 -- 172.21.15.160:0/2627660774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04cc144840 msgr2=0x7f04cc1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.247 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04cc144840 0x7f04cc1412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.248 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 -- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04cc1443e0 msgr2=0x7f04cc14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.248 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04cc1443e0 0x7f04cc14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.248 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 -- 172.21.15.160:0/2627660774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc1539f0 con 0x7f04b8004b80 2020-11-20T12:22:25.248 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.233+0000 7f04cb7fe700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8004b80 0x7f04cc142180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f04b800e3c0 tx=0x7f04bc013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:25.248 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.234+0000 7f04ab7fe700 1 -- 172.21.15.160:0/2627660774 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc017020 con 0x7f04b8004b80 2020-11-20T12:22:25.249 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.234+0000 7f04ab7fe700 1 -- 172.21.15.160:0/2627660774 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc006e80 con 0x7f04b8004b80 2020-11-20T12:22:25.249 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.234+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc153c90 con 0x7f04b8004b80 2020-11-20T12:22:25.249 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.234+0000 7f04ab7fe700 1 -- 172.21.15.160:0/2627660774 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc01a040 con 0x7f04b8004b80 2020-11-20T12:22:25.249 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.234+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc14ae60 con 0x7f04b8004b80 2020-11-20T12:22:25.249 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.235+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc14b110 con 0x7f04b8004b80 2020-11-20T12:22:25.250 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.236+0000 7f04ab7fe700 1 -- 172.21.15.160:0/2627660774 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f04bc026070 con 0x7f04b8004b80 2020-11-20T12:22:25.250 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.237+0000 7f04ab7fe700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f04a4080660 0x7f04a4082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.250 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.237+0000 7f04ab7fe700 1 -- 172.21.15.160:0/2627660774 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f04bc0a34d0 con 0x7f04b8004b80 2020-11-20T12:22:25.250 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.238+0000 7f04caffd700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f04a4080660 0x7f04a4082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.250 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.238+0000 7f04caffd700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f04a4080660 0x7f04a4082b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f04cc1532c0 tx=0x7f04c0009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:25.251 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.239+0000 7f04ab7fe700 1 -- 172.21.15.160:0/2627660774 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f04bc0780d0 con 0x7f04b8004b80 2020-11-20T12:22:25.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.423+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04cc044f60 con 0x7f04b8004b80 2020-11-20T12:22:25.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.425+0000 7f04ab7fe700 1 -- 172.21.15.160:0/2627660774 <== mon.0 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7f04bc024020 con 0x7f04b8004b80 2020-11-20T12:22:25.428 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:22:25.429 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:22:25.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f04a4080660 msgr2=0x7f04a4082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f04a4080660 0x7f04a4082b20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f04cc1532c0 tx=0x7f04c0009040).stop 2020-11-20T12:22:25.432 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8004b80 msgr2=0x7f04cc142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8004b80 0x7f04cc142180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f04b800e3c0 tx=0x7f04bc013000).stop 2020-11-20T12:22:25.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 shutdown_connections 2020-11-20T12:22:25.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f04a4080660 0x7f04a4082b20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04cc144840 0x7f04cc1412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.433 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8004b80 0x7f04cc142180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 --2- 172.21.15.160:0/2627660774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04cc1443e0 0x7f04cc14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.427+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 >> 172.21.15.160:0/2627660774 conn(0x7f04cc062ef0 msgr2=0x7f04cc149d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:25.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.428+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 shutdown_connections 2020-11-20T12:22:25.434 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.428+0000 7f04d0d85700 1 -- 172.21.15.160:0/2627660774 wait complete. 2020-11-20T12:22:25.452 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:22:25.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.674+0000 7f1a9b59e700 1 Processor -- start 2020-11-20T12:22:25.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.674+0000 7f1a9b59e700 1 -- start start 2020-11-20T12:22:25.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.676+0000 7f1a9b59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1a9c0616b0 0x7f1a9c063490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.676+0000 7f1a9b59e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c061b80 con 0x7f1a9c0c4260 2020-11-20T12:22:25.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.676+0000 7f1a9b59e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9c061e20 con 0x7f1a9c0630b0 2020-11-20T12:22:25.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.676+0000 7f1a9b59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9c0c3ba0 con 0x7f1a9c0616b0 2020-11-20T12:22:25.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.676+0000 7f1a99d9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f1a9c0616b0 0x7f1a9c063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.676+0000 7f1a9a59c700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f1a9c0630b0 0x7f1a9c0bf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47428/0 (socket says 172.21.15.160:47428) 2020-11-20T12:22:25.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.676+0000 7f1a9a59c700 1 -- 172.21.15.160:0/471546379 learned_addr learned my addr 172.21.15.160:0/471546379 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:25.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.677+0000 7f1a99d9b700 1 -- 172.21.15.160:0/471546379 >> v1:172.21.15.150:6789/0 conn(0x7f1a9c0630b0 legacy=0x7f1a9c0bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.677+0000 7f1a99d9b700 1 -- 172.21.15.160:0/471546379 >> v1:172.21.15.134:6789/0 conn(0x7f1a9c0c4260 legacy=0x7f1a9c14dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.677+0000 7f1a99d9b700 1 -- 172.21.15.160:0/471546379 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0620c0 con 0x7f1a9c0616b0 2020-11-20T12:22:25.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.677+0000 7f1a9959a700 1 -- 172.21.15.160:0/471546379 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010858273 0 0) 0x7f1a9c061b80 con 0x7f1a9c0c4260 2020-11-20T12:22:25.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.677+0000 7f1a99d9b700 1 --2- 172.21.15.160:0/471546379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c063490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1a9c061d50 tx=0x7f1a90006df0).ready entity=mon.2 client_cookie=4d794b59f6a02c15 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:25.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9959a700 1 -- 172.21.15.160:0/471546379 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90009730 con 0x7f1a9c0616b0 2020-11-20T12:22:25.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9959a700 1 -- 172.21.15.160:0/471546379 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90009890 con 0x7f1a9c0616b0 2020-11-20T12:22:25.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9959a700 1 -- 172.21.15.160:0/471546379 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90009c10 con 0x7f1a9c0616b0 2020-11-20T12:22:25.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9b59e700 1 -- 172.21.15.160:0/471546379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0616b0 msgr2=0x7f1a9c063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/471546379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c063490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f1a9c061d50 tx=0x7f1a90006df0).stop 2020-11-20T12:22:25.693 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9b59e700 1 -- 172.21.15.160:0/471546379 shutdown_connections 2020-11-20T12:22:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/471546379 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c063490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9b59e700 1 -- 172.21.15.160:0/471546379 >> 172.21.15.160:0/471546379 conn(0x7f1a9c060140 msgr2=0x7f1a9c060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:25.694 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9b59e700 1 -- 172.21.15.160:0/471546379 shutdown_connections 2020-11-20T12:22:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.678+0000 7f1a9b59e700 1 -- 172.21.15.160:0/471546379 wait complete. 2020-11-20T12:22:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.680+0000 7f1a9b59e700 1 Processor -- start 2020-11-20T12:22:25.695 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.680+0000 7f1a9b59e700 1 -- start start 2020-11-20T12:22:25.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.681+0000 7f1a9b59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.681+0000 7f1a9b59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9c0630b0 0x7f1a9c160a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.696 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.681+0000 7f1a9b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0c4260 0x7f1a9c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.681+0000 7f1a9b59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c151450 con 0x7f1a9c0630b0 2020-11-20T12:22:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.681+0000 7f1a9b59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c150f10 con 0x7f1a9c0616b0 2020-11-20T12:22:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.681+0000 7f1a9b59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9c1511b0 con 0x7f1a9c0c4260 2020-11-20T12:22:25.697 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c14e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51726/0 (socket says 172.21.15.160:51726) 2020-11-20T12:22:25.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 -- 172.21.15.160:0/3889795252 learned_addr learned my addr 172.21.15.160:0/3889795252 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:25.698 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a99d9b700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9c0630b0 0x7f1a9c160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.699 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9ad9d700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0c4260 0x7f1a9c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.699 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 -- 172.21.15.160:0/3889795252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0c4260 msgr2=0x7f1a9c154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.699 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0c4260 0x7f1a9c154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.700 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 -- 172.21.15.160:0/3889795252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9c0630b0 msgr2=0x7f1a9c160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.700 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9c0630b0 0x7f1a9c160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.700 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 -- 172.21.15.160:0/3889795252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c153c80 con 0x7f1a9c0616b0 2020-11-20T12:22:25.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.682+0000 7f1a9a59c700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c14e2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1a8c00c830 tx=0x7f1a8c007bf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:25.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.683+0000 7f1a8a7fc700 1 -- 172.21.15.160:0/3889795252 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0072e0 con 0x7f1a9c0616b0 2020-11-20T12:22:25.701 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.683+0000 7f1a8a7fc700 1 -- 172.21.15.160:0/3889795252 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c007440 con 0x7f1a9c0616b0 2020-11-20T12:22:25.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.683+0000 7f1a8a7fc700 1 -- 172.21.15.160:0/3889795252 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c005850 con 0x7f1a9c0616b0 2020-11-20T12:22:25.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.683+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9c153f20 con 0x7f1a9c0616b0 2020-11-20T12:22:25.702 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.683+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a9c160f30 con 0x7f1a9c0616b0 2020-11-20T12:22:25.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.684+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9c044f60 con 0x7f1a9c0616b0 2020-11-20T12:22:25.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.686+0000 7f1a8a7fc700 1 -- 172.21.15.160:0/3889795252 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1a8c010070 con 0x7f1a9c0616b0 2020-11-20T12:22:25.703 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.687+0000 7f1a8a7fc700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1a70080630 0x7f1a70082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:25.704 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.687+0000 7f1a8a7fc700 1 -- 172.21.15.160:0/3889795252 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f1a8c0a22b0 con 0x7f1a9c0616b0 2020-11-20T12:22:25.704 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.687+0000 7f1a99d9b700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1a70080630 0x7f1a70082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:25.704 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.688+0000 7f1a99d9b700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1a70080630 0x7f1a70082af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1a9c061d50 tx=0x7f1a90015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:25.704 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.688+0000 7f1a8a7fc700 1 -- 172.21.15.160:0/3889795252 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1a8c076eb0 con 0x7f1a9c0616b0 2020-11-20T12:22:25.871 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.868+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a9c14dfb0 con 0x7f1a70080630 2020-11-20T12:22:25.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.875+0000 7f1a8a7fc700 1 -- 172.21.15.160:0/3889795252 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+148914 (secure 0 0 0) 0x7f1a9c14dfb0 con 0x7f1a70080630 2020-11-20T12:22:25.879 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:22:25.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1a70080630 msgr2=0x7f1a70082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1a70080630 0x7f1a70082af0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1a9c061d50 tx=0x7f1a90015000).stop 2020-11-20T12:22:25.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a9c0616b0 msgr2=0x7f1a9c14e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:25.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c14e2b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1a8c00c830 tx=0x7f1a8c007bf0).stop 2020-11-20T12:22:25.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 shutdown_connections 2020-11-20T12:22:25.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1a70080630 0x7f1a70082af0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a9c0c4260 0x7f1a9c154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1a9c0616b0 0x7f1a9c14e2b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 --2- 172.21.15.160:0/3889795252 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a9c0630b0 0x7f1a9c160a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:25.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 >> 172.21.15.160:0/3889795252 conn(0x7f1a9c060140 msgr2=0x7f1a9c0c1080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:25.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 shutdown_connections 2020-11-20T12:22:25.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:25.879+0000 7f1a9b59e700 1 -- 172.21.15.160:0/3889795252 wait complete. 2020-11-20T12:22:25.892 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2020-11-20T12:22:25.905 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2020-11-20T12:22:24.197183+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":218189778,"num_objects":85,"num_object_clones":0,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":1316,"num_read_kb":4882,"num_write":116301,"num_write_kb":1168315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86641,"ondisk_log_size":86641,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124392560,"kb_used":10116276,"kb_used_data":1114287640,"kb_used_omap":188243,"kb_used_meta":0,"kb_avail":1114276284,"statfs":{"total":1151377981440,"available":1141018914816,"internally_reserved":11628544,"allocated":1141030543360,"data_stored":1141030543360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":192761067,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-113791769,"num_objects":-5318,"num_object_clones":0,"num_object_copies":-10636,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5318,"num_whiteouts":0,"num_read":45,"num_read_kb":489,"num_write":5827,"num_write_kb":24141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-220,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002493"},"pg_stats":[{"pgid":"4.2","version":"26'12174","reported_seq":"12183","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.536103+0000","last_change":"2020-11-20T12:14:10.897094+0000","last_active":"2020-11-20T12:22:23.536103+0000","last_peered":"2020-11-20T12:22:23.536103+0000","last_clean":"2020-11-20T12:22:23.536103+0000","last_became_active":"2020-11-20T12:14:10.894103+0000","last_became_peered":"2020-11-20T12:14:10.894103+0000","last_unstale":"2020-11-20T12:22:23.536103+0000","last_undegraded":"2020-11-20T12:22:23.536103+0000","last_fullsized":"2020-11-20T12:22:23.536103+0000","mapping_epoch":24,"log_start":"26'2100","ondisk_log_start":"26'2100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10074,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":103355,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13373,"num_write_kb":78386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.881088+0000","last_change":"2020-11-20T12:14:06.159953+0000","last_active":"2020-11-20T12:14:10.881088+0000","last_peered":"2020-11-20T12:14:10.881088+0000","last_clean":"2020-11-20T12:14:10.881088+0000","last_became_active":"2020-11-20T12:14:06.159519+0000","last_became_peered":"2020-11-20T12:14:06.159519+0000","last_unstale":"2020-11-20T12:14:10.881088+0000","last_undegraded":"2020-11-20T12:14:10.881088+0000","last_fullsized":"2020-11-20T12:14:10.881088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'959","reported_seq":"969","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.514742+0000","last_change":"2020-11-20T12:14:10.335478+0000","last_active":"2020-11-20T12:22:23.514742+0000","last_peered":"2020-11-20T12:22:23.514742+0000","last_clean":"2020-11-20T12:22:23.514742+0000","last_became_active":"2020-11-20T12:14:10.335057+0000","last_became_peered":"2020-11-20T12:14:10.335057+0000","last_unstale":"2020-11-20T12:22:23.514742+0000","last_undegraded":"2020-11-20T12:22:23.514742+0000","last_fullsized":"2020-11-20T12:22:23.514742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":959,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41943200,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":1221,"num_write_kb":97963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'12273","reported_seq":"12282","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.569412+0000","last_change":"2020-11-20T12:14:10.896061+0000","last_active":"2020-11-20T12:22:23.569412+0000","last_peered":"2020-11-20T12:22:23.569412+0000","last_clean":"2020-11-20T12:22:23.569412+0000","last_became_active":"2020-11-20T12:14:10.895690+0000","last_became_peered":"2020-11-20T12:14:10.895690+0000","last_unstale":"2020-11-20T12:22:23.569412+0000","last_undegraded":"2020-11-20T12:22:23.569412+0000","last_fullsized":"2020-11-20T12:22:23.569412+0000","mapping_epoch":24,"log_start":"26'2200","ondisk_log_start":"26'2200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10073,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":787,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13503,"num_write_kb":81662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.883428+0000","last_change":"2020-11-20T12:14:07.008579+0000","last_active":"2020-11-20T12:14:10.883428+0000","last_peered":"2020-11-20T12:14:10.883428+0000","last_clean":"2020-11-20T12:14:10.883428+0000","last_became_active":"2020-11-20T12:14:07.008291+0000","last_became_peered":"2020-11-20T12:14:07.008291+0000","last_unstale":"2020-11-20T12:14:10.883428+0000","last_undegraded":"2020-11-20T12:14:10.883428+0000","last_fullsized":"2020-11-20T12:14:10.883428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'614","reported_seq":"624","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.512130+0000","last_change":"2020-11-20T12:14:10.534558+0000","last_active":"2020-11-20T12:22:23.512130+0000","last_peered":"2020-11-20T12:22:23.512130+0000","last_clean":"2020-11-20T12:22:23.512130+0000","last_became_active":"2020-11-20T12:14:10.534094+0000","last_became_peered":"2020-11-20T12:14:10.534094+0000","last_unstale":"2020-11-20T12:22:23.512130+0000","last_undegraded":"2020-11-20T12:22:23.512130+0000","last_fullsized":"2020-11-20T12:22:23.512130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":614,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360162,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":932,"num_write_kb":65028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"26'12061","reported_seq":"12070","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.573548+0000","last_change":"2020-11-20T12:14:10.899194+0000","last_active":"2020-11-20T12:22:23.573548+0000","last_peered":"2020-11-20T12:22:23.573548+0000","last_clean":"2020-11-20T12:22:23.573548+0000","last_became_active":"2020-11-20T12:14:10.898829+0000","last_became_peered":"2020-11-20T12:14:10.898829+0000","last_unstale":"2020-11-20T12:22:23.573548+0000","last_undegraded":"2020-11-20T12:22:23.573548+0000","last_fullsized":"2020-11-20T12:22:23.573548+0000","mapping_epoch":24,"log_start":"26'2000","ondisk_log_start":"26'2000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10061,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13210,"num_write_kb":79226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.894017+0000","last_change":"2020-11-20T12:14:07.008594+0000","last_active":"2020-11-20T12:14:10.894017+0000","last_peered":"2020-11-20T12:14:10.894017+0000","last_clean":"2020-11-20T12:14:10.894017+0000","last_became_active":"2020-11-20T12:14:07.008127+0000","last_became_peered":"2020-11-20T12:14:07.008127+0000","last_unstale":"2020-11-20T12:14:10.894017+0000","last_undegraded":"2020-11-20T12:14:10.894017+0000","last_fullsized":"2020-11-20T12:14:10.894017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'659","reported_seq":"669","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:21.520353+0000","last_change":"2020-11-20T12:14:10.341124+0000","last_active":"2020-11-20T12:22:21.520353+0000","last_peered":"2020-11-20T12:22:21.520353+0000","last_clean":"2020-11-20T12:22:21.520353+0000","last_became_active":"2020-11-20T12:14:10.340407+0000","last_became_peered":"2020-11-20T12:14:10.340407+0000","last_unstale":"2020-11-20T12:22:21.520353+0000","last_undegraded":"2020-11-20T12:22:21.520353+0000","last_fullsized":"2020-11-20T12:22:21.520353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":659,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":941,"num_write_kb":72883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'12189","reported_seq":"12198","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.560063+0000","last_change":"2020-11-20T12:14:10.894433+0000","last_active":"2020-11-20T12:22:23.560063+0000","last_peered":"2020-11-20T12:22:23.560063+0000","last_clean":"2020-11-20T12:22:23.560063+0000","last_became_active":"2020-11-20T12:14:10.894032+0000","last_became_peered":"2020-11-20T12:14:10.894032+0000","last_unstale":"2020-11-20T12:22:23.560063+0000","last_undegraded":"2020-11-20T12:22:23.560063+0000","last_fullsized":"2020-11-20T12:22:23.560063+0000","mapping_epoch":24,"log_start":"26'2100","ondisk_log_start":"26'2100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13414,"num_write_kb":79172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.889703+0000","last_change":"2020-11-20T12:14:06.159050+0000","last_active":"2020-11-20T12:14:10.889703+0000","last_peered":"2020-11-20T12:14:10.889703+0000","last_clean":"2020-11-20T12:14:10.889703+0000","last_became_active":"2020-11-20T12:14:06.158623+0000","last_became_peered":"2020-11-20T12:14:06.158623+0000","last_unstale":"2020-11-20T12:14:10.889703+0000","last_undegraded":"2020-11-20T12:14:10.889703+0000","last_fullsized":"2020-11-20T12:14:10.889703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891446+0000","last_change":"2020-11-20T12:13:58.998090+0000","last_active":"2020-11-20T12:14:10.891446+0000","last_peered":"2020-11-20T12:14:10.891446+0000","last_clean":"2020-11-20T12:14:10.891446+0000","last_became_active":"2020-11-20T12:13:58.997799+0000","last_became_peered":"2020-11-20T12:13:58.997799+0000","last_unstale":"2020-11-20T12:14:10.891446+0000","last_undegraded":"2020-11-20T12:14:10.891446+0000","last_fullsized":"2020-11-20T12:14:10.891446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_clean_scrub_stamp":"2020-11-20T12:13:54.281756+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"26'699","reported_seq":"709","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.317009+0000","last_change":"2020-11-20T12:14:10.537982+0000","last_active":"2020-11-20T12:22:23.317009+0000","last_peered":"2020-11-20T12:22:23.317009+0000","last_clean":"2020-11-20T12:22:23.317009+0000","last_became_active":"2020-11-20T12:14:10.537671+0000","last_became_peered":"2020-11-20T12:14:10.537671+0000","last_unstale":"2020-11-20T12:22:23.317009+0000","last_undegraded":"2020-11-20T12:22:23.317009+0000","last_fullsized":"2020-11-20T12:22:23.317009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":699,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37146399,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":1008,"num_write_kb":80784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.6","version":"26'11965","reported_seq":"11974","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.560616+0000","last_change":"2020-11-20T12:14:10.895302+0000","last_active":"2020-11-20T12:22:23.560616+0000","last_peered":"2020-11-20T12:22:23.560616+0000","last_clean":"2020-11-20T12:22:23.560616+0000","last_became_active":"2020-11-20T12:14:10.894932+0000","last_became_peered":"2020-11-20T12:14:10.894932+0000","last_unstale":"2020-11-20T12:22:23.560616+0000","last_undegraded":"2020-11-20T12:22:23.560616+0000","last_fullsized":"2020-11-20T12:22:23.560616+0000","mapping_epoch":24,"log_start":"26'1900","ondisk_log_start":"26'1900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10065,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13123,"num_write_kb":78974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891316+0000","last_change":"2020-11-20T12:14:06.162793+0000","last_active":"2020-11-20T12:14:10.891316+0000","last_peered":"2020-11-20T12:14:10.891316+0000","last_clean":"2020-11-20T12:14:10.891316+0000","last_became_active":"2020-11-20T12:14:06.162506+0000","last_became_peered":"2020-11-20T12:14:06.162506+0000","last_unstale":"2020-11-20T12:14:10.891316+0000","last_undegraded":"2020-11-20T12:14:10.891316+0000","last_fullsized":"2020-11-20T12:14:10.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"26'1275","reported_seq":"2051","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.514831+0000","last_change":"2020-11-20T12:14:10.336410+0000","last_active":"2020-11-20T12:22:23.514831+0000","last_peered":"2020-11-20T12:22:23.514831+0000","last_clean":"2020-11-20T12:22:23.514831+0000","last_became_active":"2020-11-20T12:14:10.336077+0000","last_became_peered":"2020-11-20T12:14:10.336077+0000","last_unstale":"2020-11-20T12:22:23.514831+0000","last_undegraded":"2020-11-20T12:22:23.514831+0000","last_fullsized":"2020-11-20T12:22:23.514831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":1275,"ondisk_log_size":1275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":833,"num_read_kb":4591,"num_write":1588,"num_write_kb":41099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"26'12431","reported_seq":"12440","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.531354+0000","last_change":"2020-11-20T12:14:10.896686+0000","last_active":"2020-11-20T12:22:23.531354+0000","last_peered":"2020-11-20T12:22:23.531354+0000","last_clean":"2020-11-20T12:22:23.531354+0000","last_became_active":"2020-11-20T12:14:10.896333+0000","last_became_peered":"2020-11-20T12:14:10.896333+0000","last_unstale":"2020-11-20T12:22:23.531354+0000","last_undegraded":"2020-11-20T12:22:23.531354+0000","last_fullsized":"2020-11-20T12:22:23.531354+0000","mapping_epoch":24,"log_start":"26'2400","ondisk_log_start":"26'2400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13626,"num_write_kb":83115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.885785+0000","last_change":"2020-11-20T12:14:06.163774+0000","last_active":"2020-11-20T12:14:10.885785+0000","last_peered":"2020-11-20T12:14:10.885785+0000","last_clean":"2020-11-20T12:14:10.885785+0000","last_became_active":"2020-11-20T12:14:06.162783+0000","last_became_peered":"2020-11-20T12:14:06.162783+0000","last_unstale":"2020-11-20T12:14:10.885785+0000","last_undegraded":"2020-11-20T12:14:10.885785+0000","last_fullsized":"2020-11-20T12:14:10.885785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'755","reported_seq":"765","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.317304+0000","last_change":"2020-11-20T12:14:10.339850+0000","last_active":"2020-11-20T12:22:23.317304+0000","last_peered":"2020-11-20T12:22:23.317304+0000","last_clean":"2020-11-20T12:22:23.317304+0000","last_became_active":"2020-11-20T12:14:10.339332+0000","last_became_peered":"2020-11-20T12:14:10.339332+0000","last_unstale":"2020-11-20T12:22:23.317304+0000","last_undegraded":"2020-11-20T12:22:23.317304+0000","last_fullsized":"2020-11-20T12:22:23.317304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":85,"num_read_kb":0,"num_write":1106,"num_write_kb":48894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.0","version":"26'12533","reported_seq":"12542","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.540341+0000","last_change":"2020-11-20T12:14:10.892096+0000","last_active":"2020-11-20T12:22:23.540341+0000","last_peered":"2020-11-20T12:22:23.540341+0000","last_clean":"2020-11-20T12:22:23.540341+0000","last_became_active":"2020-11-20T12:14:10.891647+0000","last_became_peered":"2020-11-20T12:14:10.891647+0000","last_unstale":"2020-11-20T12:22:23.540341+0000","last_undegraded":"2020-11-20T12:22:23.540341+0000","last_fullsized":"2020-11-20T12:22:23.540341+0000","mapping_epoch":24,"log_start":"26'2500","ondisk_log_start":"26'2500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10033,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13769,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'541","reported_seq":"576","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.216144+0000","last_change":"2020-11-20T12:14:10.339704+0000","last_active":"2020-11-20T12:22:23.216144+0000","last_peered":"2020-11-20T12:22:23.216144+0000","last_clean":"2020-11-20T12:22:23.216144+0000","last_became_active":"2020-11-20T12:14:10.339274+0000","last_became_peered":"2020-11-20T12:14:10.339274+0000","last_unstale":"2020-11-20T12:22:23.216144+0000","last_undegraded":"2020-11-20T12:22:23.216144+0000","last_fullsized":"2020-11-20T12:22:23.216144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":541,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8670849,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":82,"num_read_kb":291,"num_write":836,"num_write_kb":32655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.881121+0000","last_change":"2020-11-20T12:14:06.894405+0000","last_active":"2020-11-20T12:14:10.881121+0000","last_peered":"2020-11-20T12:14:10.881121+0000","last_clean":"2020-11-20T12:14:10.881121+0000","last_became_active":"2020-11-20T12:14:06.894112+0000","last_became_peered":"2020-11-20T12:14:06.894112+0000","last_unstale":"2020-11-20T12:14:10.881121+0000","last_undegraded":"2020-11-20T12:14:10.881121+0000","last_fullsized":"2020-11-20T12:14:10.881121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'12310","reported_seq":"12319","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.533665+0000","last_change":"2020-11-20T12:14:11.293900+0000","last_active":"2020-11-20T12:22:23.533665+0000","last_peered":"2020-11-20T12:22:23.533665+0000","last_clean":"2020-11-20T12:22:23.533665+0000","last_became_active":"2020-11-20T12:14:11.293129+0000","last_became_peered":"2020-11-20T12:14:11.293129+0000","last_unstale":"2020-11-20T12:22:23.533665+0000","last_undegraded":"2020-11-20T12:22:23.533665+0000","last_fullsized":"2020-11-20T12:22:23.533665+0000","mapping_epoch":24,"log_start":"26'2300","ondisk_log_start":"26'2300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10010,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":301087,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13535,"num_write_kb":82637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.892839+0000","last_change":"2020-11-20T12:14:06.894741+0000","last_active":"2020-11-20T12:14:10.892839+0000","last_peered":"2020-11-20T12:14:10.892839+0000","last_clean":"2020-11-20T12:14:10.892839+0000","last_became_active":"2020-11-20T12:14:06.894407+0000","last_became_peered":"2020-11-20T12:14:06.894407+0000","last_unstale":"2020-11-20T12:14:10.892839+0000","last_undegraded":"2020-11-20T12:14:10.892839+0000","last_fullsized":"2020-11-20T12:14:10.892839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"26'700","reported_seq":"710","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.512316+0000","last_change":"2020-11-20T12:14:10.532926+0000","last_active":"2020-11-20T12:22:23.512316+0000","last_peered":"2020-11-20T12:22:23.512316+0000","last_clean":"2020-11-20T12:22:23.512316+0000","last_became_active":"2020-11-20T12:14:10.532589+0000","last_became_peered":"2020-11-20T12:14:10.532589+0000","last_unstale":"2020-11-20T12:22:23.512316+0000","last_undegraded":"2020-11-20T12:22:23.512316+0000","last_fullsized":"2020-11-20T12:22:23.512316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":700,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":1113,"num_write_kb":81138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":405229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107553,"num_write_kb":647856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80436,"ondisk_log_size":80436,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":217784549,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":1316,"num_read_kb":4882,"num_write":8745,"num_write_kb":520444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6202,"ondisk_log_size":6202,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444136,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":850780,"kb_used_data":92849160,"kb_used_omap":15999,"kb_used_meta":0,"kb_avail":92848600,"statfs":{"total":95948165120,"available":95076966400,"internally_reserved":573440,"allocated":95077539840,"data_stored":95077539840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16383317,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.244,"15min":1.5680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8859999999999999,"5min":4.7069999999999999,"15min":4.7460000000000004},"last":1.268},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.4159999999999999,"15min":1.673},"min":{"1min":0.876,"5min":0.85999999999999999,"15min":0.82899999999999996},"max":{"1min":1.7929999999999999,"5min":4.7569999999999997,"15min":4.8070000000000004},"last":1.458}]},{"osd":1,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.083,"15min":1.1919999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.383,"5min":1.611,"15min":1.8560000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.1739999999999999,"15min":1.244},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3600000000000001,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.2070000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.94999999999999996,"15min":0.97299999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96099999999999997,"15min":0.96299999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3620000000000001,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":0.83599999999999997}]},{"osd":3,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0629999999999999,"15min":1.2789999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.8740000000000001,"5min":3.1589999999999998,"15min":3.194},"last":1.024},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.512,"15min":1.6970000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.996,"5min":3.5099999999999998,"15min":6.4779999999999998},"last":1.5069999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2210000000000001,"15min":1.262},"min":{"1min":0.747,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.619,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.071},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0640000000000001,"15min":1.097},"min":{"1min":0.76200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.341,"5min":1.853,"15min":1.853},"last":0.90200000000000002}]},{"osd":5,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3620000000000001,"15min":1.345},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8069999999999999,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.409,"15min":1.385},"min":{"1min":1.0009999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7889999999999999,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.3440000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.4810000000000001,"15min":1.6399999999999999},"min":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1869999999999998,"5min":10.239000000000001,"15min":10.239000000000001},"last":1.179},{"interface":"front","average":{"1min":1.641,"5min":1.804,"15min":1.921},"min":{"1min":1.3169999999999999,"5min":1.2649999999999999,"15min":1.2509999999999999},"max":{"1min":2.073,"5min":10.191000000000001,"15min":10.191000000000001},"last":1.633}]},{"osd":7,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.5900000000000001,"15min":1.635},"min":{"1min":1.097,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.0169999999999999,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.577},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.589,"15min":1.6439999999999999},"min":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":1.929,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.802}]},{"osd":8,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.282,"15min":1.3180000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.099},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.653,"15min":1.7290000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.1789999999999998,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.736}]},{"osd":10,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.677,"15min":1.706},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":2.1579999999999999,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4179999999999999,"15min":1.4810000000000001},"min":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.0579999999999998,"5min":2.532,"15min":2.532},"last":1.25}]}]},{"osd":10,"up_from":17,"seq":73014444135,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":877536,"kb_used_data":92825840,"kb_used_omap":21572,"kb_used_meta":0,"kb_avail":92821844,"statfs":{"total":95948165120,"available":95049568256,"internally_reserved":4091904,"allocated":95053660160,"data_stored":95053660160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22089803,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.599,"15min":1.8240000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.69499999999999995},"max":{"1min":3.419,"5min":32.482999999999997,"15min":39.473999999999997},"last":1.069},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.48,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":4.6379999999999999,"5min":32.982999999999997,"15min":239.38800000000001},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.93000000000000005,"15min":1.0289999999999999},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4630000000000001,"5min":6.4720000000000004,"15min":39.573},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.88700000000000001},"min":{"1min":0.629,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1579999999999999,"5min":1.407,"15min":2.0870000000000002},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0600000000000001,"15min":1.083},"min":{"1min":0.68700000000000006,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.367,"15min":1.468},"min":{"1min":0.93999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0419999999999998,"5min":6.7140000000000004,"15min":38.835000000000001},"last":1.3220000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3959999999999999,"15min":1.667},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":4.125,"5min":4.5640000000000001,"15min":7.9409999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.47,"15min":1.752},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.80800000000000005},"max":{"1min":2.738,"5min":4.4829999999999997,"15min":8.6170000000000009},"last":1.097}]},{"osd":4,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.339,"15min":1.444},"min":{"1min":0.81000000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.2109999999999999,"5min":6.9589999999999996,"15min":38.975000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.202,"5min":1.214,"15min":1.2470000000000001},"min":{"1min":0.92300000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.6499999999999999,"5min":2.2389999999999999,"15min":3.7450000000000001},"last":0.90500000000000003}]},{"osd":5,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5129999999999999,"15min":1.899},"min":{"1min":1.0840000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.153,"5min":7.2629999999999999,"15min":39.110999999999997},"last":1.198},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3540000000000001,"15min":1.4450000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.7649999999999999,"5min":2.0169999999999999,"15min":3.3410000000000002},"last":1.2909999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.946,"15min":2.694},"min":{"1min":1.2090000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.8660000000000001,"5min":33.418999999999997,"15min":200.03700000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.619,"5min":2.1070000000000002,"15min":2.3220000000000001},"min":{"1min":1.2450000000000001,"5min":1.204,"15min":1.204},"max":{"1min":2.278,"5min":32.927,"15min":39.350999999999999},"last":1.448}]},{"osd":7,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.526,"15min":1.7829999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":2.0099999999999998,"5min":3.6360000000000001,"15min":8.1379999999999999},"last":1.129},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.7},"min":{"1min":0.95899999999999996,"5min":0.876,"15min":0.77700000000000002},"max":{"1min":2.6160000000000001,"5min":3.3100000000000001,"15min":8.7789999999999999},"last":1.252}]},{"osd":9,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.782,"5min":2.2120000000000002,"15min":2.46},"min":{"1min":1.4379999999999999,"5min":1.268,"15min":1.268},"max":{"1min":3.1070000000000002,"5min":29.462,"15min":29.462},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.702,"5min":2.2799999999999998,"15min":2.5270000000000001},"min":{"1min":1.268,"5min":1.268,"15min":1.268},"max":{"1min":2.4710000000000001,"5min":29.373999999999999,"15min":39.234000000000002},"last":1.5700000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.5660000000000001,"15min":1.8640000000000001},"min":{"1min":1.2609999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.1269999999999998,"5min":2.2429999999999999,"15min":7.7889999999999997},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.681,"5min":1.6519999999999999,"15min":1.8979999999999999},"min":{"1min":1.224,"5min":1.091,"15min":1.091},"max":{"1min":2.984,"5min":3.4420000000000002,"15min":8.9450000000000003},"last":1.3480000000000001}]}]},{"osd":9,"up_from":17,"seq":73014444135,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":847508,"kb_used_data":92853276,"kb_used_omap":16822,"kb_used_meta":0,"kb_avail":92851872,"statfs":{"total":95948165120,"available":95080316928,"internally_reserved":1437696,"allocated":95081754624,"data_stored":95081754624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17226147,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":3.4889999999999999,"15min":3.375},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":5.9969999999999999,"5min":13.090999999999999,"15min":18.306000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":3.3279999999999998,"5min":24.893000000000001,"15min":10.641999999999999},"min":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":24.001000000000001,"5min":935.75699999999995,"15min":935.75699999999995},"last":3.9239999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.077,"5min":12.826000000000001,"15min":6.0579999999999998},"min":{"1min":0.90800000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":23.058,"5min":535.80399999999997,"15min":535.80399999999997},"last":2.774},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.907,"15min":2.4300000000000002},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.4609999999999999,"5min":6.7619999999999996,"15min":18.015999999999998},"last":1.28}]},{"osd":2,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.3319999999999999,"5min":13.041,"15min":6.601},"min":{"1min":0.88800000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":23.382000000000001,"5min":535.95100000000002,"15min":535.95100000000002},"last":2.9039999999999999},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.1469999999999998,"15min":2.5779999999999998},"min":{"1min":0.79000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.7709999999999999,"5min":6.6600000000000001,"15min":13.66},"last":1.385}]},{"osd":3,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.419,"5min":3.7469999999999999,"15min":3.8900000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":4.8609999999999998,"5min":13.281000000000001,"15min":14.066000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":2.6469999999999998,"5min":3.8929999999999998,"15min":4.3680000000000003},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":7.0049999999999999,"5min":12.503,"15min":18.175999999999998},"last":1.4139999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":13.481999999999999,"15min":7.3499999999999996},"min":{"1min":1.1779999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":23.251999999999999,"5min":556.02599999999995,"15min":556.02599999999995},"last":3.0350000000000001},{"interface":"front","average":{"1min":2.1589999999999998,"5min":2.5870000000000002,"15min":3.4820000000000002},"min":{"1min":1.1120000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":4.931,"5min":18.196000000000002,"15min":18.196000000000002},"last":2.0899999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.319,"15min":3.524},"min":{"1min":1.399,"5min":1.175,"15min":1.175},"max":{"1min":6.5700000000000003,"5min":7.1479999999999997,"15min":18.446000000000002},"last":1.863},{"interface":"front","average":{"1min":2.2999999999999998,"5min":2.6930000000000001,"15min":3.927},"min":{"1min":1.2270000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":5.0030000000000001,"5min":8.8900000000000006,"15min":19.318000000000001},"last":2.2320000000000002}]},{"osd":6,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":4.444,"15min":5.4000000000000004},"min":{"1min":1.708,"5min":1.48,"15min":1.48},"max":{"1min":12.815,"5min":17.027000000000001,"15min":24.981000000000002},"last":2.6840000000000002},{"interface":"front","average":{"1min":4.5549999999999997,"5min":15.795,"15min":9.0790000000000006},"min":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":23.866,"5min":589.55999999999995,"15min":589.55999999999995},"last":3.4750000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.4950000000000001,"5min":2.5339999999999998,"15min":4.1159999999999997},"min":{"1min":1.5780000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"max":{"1min":6.7169999999999996,"5min":7.5510000000000002,"15min":18.579000000000001},"last":2.0030000000000001},{"interface":"front","average":{"1min":4.1360000000000001,"5min":13.949,"15min":7.7789999999999999},"min":{"1min":1.5449999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":23.529,"5min":561.18200000000002,"15min":561.18200000000002},"last":3.1749999999999998}]},{"osd":10,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":3.0659999999999998,"15min":4.2679999999999998},"min":{"1min":1.369,"5min":1.286,"15min":1.286},"max":{"1min":9.2100000000000009,"5min":9.2100000000000009,"15min":19.547999999999998},"last":2.4390000000000001},{"interface":"front","average":{"1min":2.6659999999999999,"5min":2.6699999999999999,"15min":4.3769999999999998},"min":{"1min":1.8160000000000001,"5min":1.46,"15min":1.46},"max":{"1min":6.8659999999999997,"5min":7.6769999999999996,"15min":18.707000000000001},"last":2.1339999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":4.2939999999999996,"5min":14.108000000000001,"15min":8.0500000000000007},"min":{"1min":1.7949999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"max":{"1min":23.658999999999999,"5min":561.32899999999995,"15min":561.32899999999995},"last":3.2839999999999998},{"interface":"front","average":{"1min":2.609,"5min":3.1269999999999998,"15min":4.5359999999999996},"min":{"1min":1.5469999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"max":{"1min":5.181,"5min":12.641,"15min":19.780000000000001},"last":2.3620000000000001}]}]},{"osd":8,"up_from":17,"seq":73014444137,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":837988,"kb_used_data":92862016,"kb_used_omap":10841,"kb_used_meta":0,"kb_avail":92861392,"statfs":{"total":95948165120,"available":95090065408,"internally_reserved":638976,"allocated":95090704384,"data_stored":95090704384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11101854,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7689999999999999,"5min":1.377,"15min":2.2229999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":19.047999999999998,"5min":19.047999999999998,"15min":197.74100000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.5109999999999999,"15min":2.4260000000000002},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":19.082999999999998,"5min":19.082999999999998,"15min":197.762},"last":1.121}]},{"osd":1,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.427,"15min":1.538},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1359999999999999,"5min":1.748,"15min":1.748},"last":1.22}]},{"osd":2,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77700000000000002,"15min":0.85999999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1539999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.751},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.98099999999999998,"15min":1.0229999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3859999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.29,"15min":1.5109999999999999},"min":{"1min":0.73399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"max":{"1min":5.8419999999999996,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.5,"5min":1.385,"15min":1.74},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":5.8940000000000001,"5min":5.8940000000000001,"15min":5.8940000000000001},"last":1.5820000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.997,"15min":1.1479999999999999},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3300000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2709999999999999,"15min":1.339},"min":{"1min":0.88800000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6559999999999999,"5min":1.764,"15min":1.764},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.4870000000000001,"15min":2.758},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82199999999999995},"max":{"1min":2.5750000000000002,"5min":5.7619999999999996,"15min":278.42200000000003},"last":0.878},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.5860000000000001,"15min":2.8290000000000002},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.6619999999999999,"5min":5.8120000000000003,"15min":278.48700000000002},"last":1.444}]},{"osd":7,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.264,"15min":1.278},"min":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.79400000000000004},"max":{"1min":1.9139999999999999,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.304,"5min":1.3720000000000001,"15min":1.407},"min":{"1min":0.95599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8120000000000001,"5min":3.3490000000000002,"15min":3.3490000000000002},"last":1.3660000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.671,"15min":4.7080000000000002},"min":{"1min":1.089,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.3100000000000001,"5min":5.7140000000000004,"15min":620.09000000000003},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.7709999999999999,"15min":1.827},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":3.1200000000000001,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":1.341}]},{"osd":10,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4870000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.827,"5min":1.9119999999999999,"15min":3.367},"last":0.999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3480000000000001,"15min":1.458},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.6299999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":1.3140000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.4510000000000001,"15min":1.5309999999999999},"min":{"1min":1.008,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.845,"5min":1.9530000000000001,"15min":2.2389999999999999},"last":1.103},{"interface":"front","average":{"1min":1.405,"5min":1.4550000000000001,"15min":1.5640000000000001},"min":{"1min":1.024,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.956,"5min":1.984,"15min":1.984},"last":1.244}]}]},{"osd":7,"up_from":17,"seq":73014444136,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":837912,"kb_used_data":92861876,"kb_used_omap":17947,"kb_used_meta":0,"kb_avail":92861468,"statfs":{"total":95948165120,"available":95090143232,"internally_reserved":417792,"allocated":95090561024,"data_stored":95090561024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18378097,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.98399999999999999,"15min":1.232},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0369999999999999,"5min":3.6760000000000002,"15min":4.8239999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3779999999999999,"15min":1.494},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.7770000000000001,"5min":5.165,"15min":27.524999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.58899999999999997,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":1.038,"15min":1.121},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.83399999999999996,"15min":0.871},"min":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.59499999999999997},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.01,"15min":0.996},"min":{"1min":0.69099999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0429999999999999,"15min":1.1299999999999999},"min":{"1min":0.755,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.482,"5min":1.615,"15min":1.615},"last":0.90000000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.548},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.74199999999999999},"max":{"1min":2.0600000000000001,"5min":5.0149999999999997,"15min":5.0149999999999997},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.335,"5min":1.3200000000000001,"15min":1.468},"min":{"1min":0.91700000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.2240000000000002,"5min":3.254,"15min":3.254},"last":0.98499999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.163,"15min":1.228},"min":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.571,"5min":1.744,"15min":1.744},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":1.0389999999999999,"5min":0.85899999999999999,"15min":0.81100000000000005},"max":{"1min":1.8129999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.0589999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5049999999999999,"15min":1.706},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.85799999999999998},"max":{"1min":2.4020000000000001,"5min":4.54,"15min":13.116},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.51,"5min":1.677,"15min":1.917},"min":{"1min":1.0940000000000001,"5min":0.871,"15min":0.871},"max":{"1min":3.9020000000000001,"5min":13.208,"15min":26.581},"last":2.3359999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.429,"15min":1.4790000000000001},"min":{"1min":1.1759999999999999,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":2.069,"5min":2.1539999999999999,"15min":2.1709999999999998},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.498,"5min":1.417,"15min":1.4299999999999999},"min":{"1min":0.98799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.0070000000000001,"5min":2.04,"15min":2.1309999999999998},"last":1.3029999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.8009999999999999,"15min":2.2839999999999998},"min":{"1min":1.22,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.849,"5min":4.9180000000000001,"15min":71.325999999999993},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.708,"5min":1.9179999999999999,"15min":2.3610000000000002},"min":{"1min":1.4219999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":2.2949999999999999,"5min":4.9429999999999996,"15min":69.656999999999996},"last":1.4179999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.458,"15min":1.5},"min":{"1min":1.0009999999999999,"5min":0.99199999999999999,"15min":0.78100000000000003},"max":{"1min":2.2709999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.4139999999999999,"15min":1.476},"min":{"1min":1.127,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.9510000000000001,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.1439999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.544,"15min":1.643},"min":{"1min":1.2290000000000001,"5min":1.125,"15min":0.97099999999999997},"max":{"1min":2.181,"5min":2.371,"15min":2.7469999999999999},"last":1.286},{"interface":"front","average":{"1min":1.611,"5min":1.5620000000000001,"15min":1.6419999999999999},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":0.92600000000000005},"max":{"1min":2.1509999999999998,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.444}]}]},{"osd":6,"up_from":17,"seq":73014444135,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":848664,"kb_used_data":92851520,"kb_used_omap":21317,"kb_used_meta":0,"kb_avail":92850716,"statfs":{"total":95948165120,"available":95079133184,"internally_reserved":823296,"allocated":95079956480,"data_stored":95079956480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21828811,"internal_metadata":0},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":3.0150000000000001,"15min":2.8370000000000002},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8839999999999999,"5min":11.977,"15min":55.573999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":2.0169999999999999,"5min":3.988,"15min":4.0449999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":5.7679999999999998,"5min":66.028999999999996,"15min":147.11099999999999},"last":3.5649999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":2.5640000000000001,"15min":2.964},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.4379999999999997,"5min":52.729999999999997,"15min":106.60899999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.9850000000000001,"5min":2.1320000000000001,"15min":3.0459999999999998},"min":{"1min":0.77100000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":5.1500000000000004,"5min":15.574999999999999,"15min":104.149},"last":1.53}]},{"osd":2,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.1669999999999998,"5min":2.899,"15min":3.4159999999999999},"min":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.742,"5min":65.375,"15min":106.741},"last":1.871},{"interface":"front","average":{"1min":2.4950000000000001,"5min":2.4049999999999998,"15min":3.5110000000000001},"min":{"1min":1.018,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":6.1790000000000003,"5min":15.702999999999999,"15min":104.271},"last":1.655}]},{"osd":3,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8340000000000001,"5min":3.6699999999999999,"15min":4.3979999999999997},"min":{"1min":1.3300000000000001,"5min":0.97699999999999998,"15min":0.81799999999999995},"max":{"1min":6.577,"5min":15.83,"15min":104.387},"last":1.78},{"interface":"front","average":{"1min":2.2320000000000002,"5min":3.4670000000000001,"15min":3.6509999999999998},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":5.5469999999999997,"5min":8.0630000000000006,"15min":55.439999999999998},"last":1.0569999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.0350000000000001,"5min":2.4449999999999998,"15min":3.1139999999999999},"min":{"1min":1.1759999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":4.1139999999999999,"5min":9.1310000000000002,"15min":55.796999999999997},"last":1.1910000000000001},{"interface":"front","average":{"1min":2.419,"5min":3.2970000000000002,"15min":4.008},"min":{"1min":1.1020000000000001,"5min":1.0349999999999999,"15min":1.0249999999999999},"max":{"1min":4.6189999999999998,"5min":65.503,"15min":106.861},"last":2}]},{"osd":7,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.9220000000000002,"5min":2.7130000000000001,"15min":4.1859999999999999},"min":{"1min":1.5309999999999999,"5min":1.0469999999999999,"15min":0.81399999999999995},"max":{"1min":6.3940000000000001,"5min":16.32,"15min":113.36799999999999},"last":1.9199999999999999},{"interface":"front","average":{"1min":2.2250000000000001,"5min":2.5110000000000001,"15min":3.3540000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":4.4950000000000001,"5min":8.202,"15min":55.915999999999997},"last":1.327}]},{"osd":8,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6360000000000001,"5min":3.5190000000000001,"15min":4.6059999999999999},"min":{"1min":1.3640000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":4.8659999999999997,"5min":65.617000000000004,"15min":107.164},"last":2.133},{"interface":"front","average":{"1min":3.0880000000000001,"5min":3.0150000000000001,"15min":4.5259999999999998},"min":{"1min":1.4059999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":7.0090000000000003,"5min":16.451000000000001,"15min":113.634},"last":2.1619999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":5.0439999999999996,"15min":6.9560000000000004},"min":{"1min":1.526,"5min":1.526,"15min":1.526},"max":{"1min":5.8920000000000003,"5min":83.903000000000006,"15min":466.512},"last":2.7890000000000001},{"interface":"front","average":{"1min":3.0289999999999999,"5min":5.1369999999999996,"15min":5.7519999999999998},"min":{"1min":1.498,"5min":1.498,"15min":1.498},"max":{"1min":5.0010000000000003,"5min":65.837999999999994,"15min":107.398},"last":2.258}]},{"osd":10,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":3.302,"5min":3.4569999999999999,"15min":4.8300000000000001},"min":{"1min":1.7689999999999999,"5min":1.383,"15min":1.2330000000000001},"max":{"1min":6.7720000000000002,"5min":36.499000000000002,"15min":113.506},"last":2.29},{"interface":"front","average":{"1min":2.5510000000000002,"5min":2.7989999999999999,"15min":3.8330000000000002},"min":{"1min":1.452,"5min":1.224,"15min":1.224},"max":{"1min":5.218,"5min":8.9109999999999996,"15min":56.043999999999997},"last":1.456}]},{"osd":11,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8340000000000001,"5min":3.6269999999999998,"15min":4.9589999999999996},"min":{"1min":1.7529999999999999,"5min":1.425,"15min":1.425},"max":{"1min":5.1470000000000002,"5min":65.727999999999994,"15min":107.282},"last":2.4009999999999998},{"interface":"front","average":{"1min":3.423,"5min":3.569,"15min":5.0519999999999996},"min":{"1min":1.8200000000000001,"5min":1.411,"15min":1.411},"max":{"1min":7.2409999999999997,"5min":36.649000000000001,"15min":113.756},"last":2.4220000000000002}]}]},{"osd":1,"up_from":17,"seq":73014444136,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":799500,"kb_used_data":92900332,"kb_used_omap":6332,"kb_used_meta":0,"kb_avail":92899880,"statfs":{"total":95948165120,"available":95129477120,"internally_reserved":462848,"allocated":95129939968,"data_stored":95129939968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6484665,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.5429999999999999,"15min":2.6240000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.0600000000000001,"5min":30.274999999999999,"15min":283.54199999999997},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.673,"15min":2.6739999999999999},"min":{"1min":0.83599999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.992,"5min":30.335000000000001,"15min":283.51499999999999},"last":1.282}]},{"osd":2,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.02,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.335,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.93000000000000005,"15min":0.98899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.393,"5min":2.149,"15min":2.149},"last":0.94699999999999995}]},{"osd":3,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.375,"15min":1.6419999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5820000000000001,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":1.125},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4690000000000001,"15min":1.6839999999999999},"min":{"1min":1,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.085,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":1.028}]},{"osd":4,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0269999999999999,"15min":1.075},"min":{"1min":0.76700000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4610000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.78200000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.512,"5min":8.7349999999999994,"15min":8.7349999999999994},"last":0.81799999999999995}]},{"osd":5,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1140000000000001,"5min":4.4779999999999998,"15min":4.4779999999999998},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.4059999999999999,"15min":1.431},"min":{"1min":0.97899999999999998,"5min":0.93400000000000005,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.22}]},{"osd":6,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":4.8630000000000004,"15min":2.839},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.86599999999999999},"max":{"1min":7.0330000000000004,"5min":280.65300000000002,"15min":280.65300000000002},"last":1.208},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.6359999999999999,"15min":1.603},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.984,"5min":13.917999999999999,"15min":13.917999999999999},"last":1.335}]},{"osd":7,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4630000000000001,"15min":1.4450000000000001},"min":{"1min":0.91100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1419999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.85099999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7809999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.0920000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1879999999999999,"15min":1.2290000000000001},"min":{"1min":0.78900000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.3919999999999999,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5900000000000001,"15min":1.629},"min":{"1min":1.046,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8220000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.3799999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.6990000000000001,"15min":1.8080000000000001},"min":{"1min":1.228,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.3759999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":1.508},{"interface":"front","average":{"1min":1.901,"5min":8.3670000000000009,"15min":6.7709999999999999},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":5.2939999999999996,"5min":500.98700000000002,"15min":743.49599999999998},"last":1.4450000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.5609999999999999,"15min":1.5660000000000001},"min":{"1min":1.1000000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":1.7549999999999999,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.389,"15min":1.468},"min":{"1min":1.0489999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.3660000000000001,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.2709999999999999}]}]},{"osd":0,"up_from":17,"seq":73014444135,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":800172,"kb_used_data":92900024,"kb_used_omap":12622,"kb_used_meta":0,"kb_avail":92899208,"statfs":{"total":95948165120,"available":95128788992,"internally_reserved":835584,"allocated":95129624576,"data_stored":95129624576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12925826,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":4.6180000000000003,"15min":2.9340000000000002},"min":{"1min":0.749,"5min":0.747,"15min":0.747},"max":{"1min":3.6989999999999998,"5min":160.18899999999999,"15min":160.18899999999999},"last":2.3220000000000001},{"interface":"front","average":{"1min":1.893,"5min":1.952,"15min":2.0169999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.9569999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":1.0760000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":2.3090000000000002,"15min":2.2360000000000002},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.54,"5min":61.881999999999998,"15min":61.881999999999998},"last":1.008},{"interface":"front","average":{"1min":2.5289999999999999,"5min":5.0670000000000002,"15min":4.6760000000000002},"min":{"1min":1.1699999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":4.4809999999999999,"5min":160.33099999999999,"15min":272.47399999999999},"last":2.4729999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7759999999999998,"5min":5.6790000000000003,"15min":5.3259999999999996},"min":{"1min":1.5289999999999999,"5min":0.94299999999999995,"15min":0.93100000000000005},"max":{"1min":4.2160000000000002,"5min":160.45599999999999,"15min":272.67399999999998},"last":3.0600000000000001},{"interface":"front","average":{"1min":2.355,"5min":3.5009999999999999,"15min":3.504},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":4.6989999999999998,"5min":62.017000000000003,"15min":62.017000000000003},"last":1.468}]},{"osd":4,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9089999999999998,"5min":5.226,"15min":5.1689999999999996},"min":{"1min":1.3540000000000001,"5min":1.0840000000000001,"15min":1.0620000000000001},"max":{"1min":4.6680000000000001,"5min":160.58099999999999,"15min":272.84399999999999},"last":3.2509999999999999},{"interface":"front","average":{"1min":2.4239999999999999,"5min":2.2480000000000002,"15min":3.6139999999999999},"min":{"1min":1.204,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":4.3029999999999999,"5min":6.6749999999999998,"15min":265.32100000000003},"last":1.4339999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":2.8650000000000002,"15min":4.3259999999999996},"min":{"1min":1.083,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":4.8449999999999998,"5min":62.151000000000003,"15min":267.30000000000001},"last":1.645},{"interface":"front","average":{"1min":3.069,"5min":5.6040000000000001,"15min":5.5529999999999999},"min":{"1min":1.496,"5min":1.2270000000000001,"15min":1.2270000000000001},"max":{"1min":5.1159999999999997,"5min":178.53999999999999,"15min":273.16199999999998},"last":3.399}]},{"osd":6,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.3239999999999998,"5min":3.4380000000000002,"15min":4.6260000000000003},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":6.1829999999999998,"5min":10.782999999999999,"15min":266.46699999999998},"last":2.137},{"interface":"front","average":{"1min":3.0920000000000001,"5min":6.827,"15min":6.2300000000000004},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":5.524,"5min":219.703,"15min":266.62599999999998},"last":2.2610000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.2549999999999999,"5min":5.8170000000000002,"15min":5.7709999999999999},"min":{"1min":1.6839999999999999,"5min":1.5229999999999999,"15min":1.3180000000000001},"max":{"1min":5.4619999999999997,"5min":178.80699999999999,"15min":273.00400000000002},"last":3.5459999999999998},{"interface":"front","average":{"1min":2.6890000000000001,"5min":2.5299999999999998,"15min":4.0739999999999998},"min":{"1min":1.452,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":4.3360000000000003,"5min":5.5590000000000002,"15min":266.05900000000003},"last":1.8600000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.8100000000000001,"5min":3.1720000000000002,"15min":4.7800000000000002},"min":{"1min":1.3859999999999999,"5min":1.137,"15min":1.137},"max":{"1min":5.1239999999999997,"5min":62.274999999999999,"15min":267.91699999999997},"last":1.96},{"interface":"front","average":{"1min":3.4510000000000001,"5min":6.0700000000000003,"15min":6.0590000000000002},"min":{"1min":1.8440000000000001,"5min":1.6359999999999999,"15min":1.5880000000000001},"max":{"1min":5.6970000000000001,"5min":178.68000000000001,"15min":273.33199999999999},"last":3.7040000000000002}]},{"osd":10,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7599999999999998,"5min":2.661,"15min":4.3090000000000002},"min":{"1min":1.575,"5min":1.3660000000000001,"15min":1.3660000000000001},"max":{"1min":4.4400000000000004,"5min":5.6900000000000004,"15min":265.68799999999999},"last":1.99},{"interface":"front","average":{"1min":3.0379999999999998,"5min":3.327,"15min":5.0090000000000003},"min":{"1min":1.53,"5min":1.4330000000000001,"15min":1.4330000000000001},"max":{"1min":5.8220000000000001,"5min":62.399000000000001,"15min":267.00299999999999},"last":1.8120000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.556,"5min":6.2549999999999999,"15min":6.3010000000000002},"min":{"1min":1.9870000000000001,"5min":1.76,"15min":1.712},"max":{"1min":5.8940000000000001,"5min":178.94300000000001,"15min":273.65899999999999},"last":3.8540000000000001},{"interface":"front","average":{"1min":3.157,"5min":3.4689999999999999,"15min":5.2430000000000003},"min":{"1min":1.6220000000000001,"5min":1.403,"15min":1.403},"max":{"1min":6.202,"5min":62.533999999999999,"15min":267.61099999999999},"last":2.1080000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444135,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797524,"kb_used_data":92902520,"kb_used_omap":6355,"kb_used_meta":0,"kb_avail":92901856,"statfs":{"total":95948165120,"available":95131500544,"internally_reserved":679936,"allocated":95132180480,"data_stored":95132180480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6508313,"internal_metadata":0},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.88800000000000001},"min":{"1min":0.626,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2749999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.91500000000000004,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2310000000000001,"5min":1.764,"15min":1.764},"last":0.92500000000000004}]},{"osd":3,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1699999999999999,"15min":1.4690000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.552,"5min":6.1600000000000001,"15min":6.9889999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.23,"15min":1.528},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.548,"5min":3.6099999999999999,"15min":7.2889999999999997},"last":1.1259999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.93899999999999995,"15min":1.1399999999999999},"min":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0860000000000001,"5min":1.4510000000000001,"15min":6.867},"last":0.879},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.093,"15min":1.1399999999999999},"min":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.917,"15min":1.917},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95499999999999996,"15min":0.98399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.381,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.079,"5min":1.0489999999999999,"15min":1.1890000000000001},"min":{"1min":0.72799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":6.7140000000000004},"last":1.0089999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":3.302,"15min":2.3639999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8049999999999999,"5min":122.973,"15min":122.973},"last":1.073},{"interface":"front","average":{"1min":1.417,"5min":1.5669999999999999,"15min":1.6910000000000001},"min":{"1min":0.94699999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":3.105,"5min":12.023999999999999,"15min":12.023999999999999},"last":1.3540000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3340000000000001},"min":{"1min":1.0249999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.335,"15min":1.329},"min":{"1min":1.002,"5min":0.872,"15min":0.84599999999999997},"max":{"1min":2.1720000000000002,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.2070000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3759999999999999,"15min":1.415},"min":{"1min":0.91500000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.806,"5min":2.302,"15min":2.302},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.458},"min":{"1min":1.0389999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8169999999999999,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.3180000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.8959999999999999,"5min":7.1989999999999998,"15min":5.1559999999999997},"min":{"1min":1.2350000000000001,"5min":1.087,"15min":1.087},"max":{"1min":6.1680000000000001,"5min":378.10700000000003,"15min":378.10700000000003},"last":1.48},{"interface":"front","average":{"1min":1.9259999999999999,"5min":7.2750000000000004,"15min":5.3019999999999996},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":6.1189999999999998,"5min":378.18599999999998,"15min":378.18599999999998},"last":1.26}]},{"osd":10,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.593,"15min":1.7629999999999999},"min":{"1min":1.121,"5min":1.1200000000000001,"15min":1.1200000000000001},"max":{"1min":1.948,"5min":4.8609999999999998,"15min":6.8940000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5269999999999999,"15min":1.677},"min":{"1min":1.161,"5min":1.04,"15min":0.99099999999999999},"max":{"1min":2.1389999999999998,"5min":4.8399999999999999,"15min":7.9790000000000001},"last":1.603}]},{"osd":11,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.609,"15min":1.794},"min":{"1min":1.236,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.3130000000000002,"5min":2.4220000000000002,"15min":6.9619999999999997},"last":1.339},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.6319999999999999,"15min":1.679},"min":{"1min":1.264,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.391}]}]},{"osd":3,"up_from":17,"seq":73014444135,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":858652,"kb_used_data":92840752,"kb_used_omap":8906,"kb_used_meta":0,"kb_avail":92840728,"statfs":{"total":95948165120,"available":95068905472,"internally_reserved":24576,"allocated":95068930048,"data_stored":95068930048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9119821,"internal_metadata":0},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":2.1059999999999999,"15min":2.012},"min":{"1min":0.78700000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.552,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":2.5190000000000001},{"interface":"front","average":{"1min":2.0230000000000001,"5min":2.4620000000000002,"15min":2.1589999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.694,"5min":6.9100000000000001,"15min":6.9100000000000001},"last":1.484}]},{"osd":2,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.6220000000000001,"15min":1.9910000000000001},"min":{"1min":0.83199999999999996,"5min":0.745,"15min":0.745},"max":{"1min":4.2759999999999998,"5min":5.4539999999999997,"15min":5.7859999999999996},"last":1.0249999999999999},{"interface":"front","average":{"1min":2.3069999999999999,"5min":2.2570000000000001,"15min":2.847},"min":{"1min":1.4239999999999999,"5min":0.879,"15min":0.879},"max":{"1min":4.0759999999999996,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":2.6480000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":2.7429999999999999,"15min":2.827},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.91900000000000004},"max":{"1min":3.6869999999999998,"5min":7.2699999999999996,"15min":7.2699999999999996},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.8009999999999999,"15min":2.3260000000000001},"min":{"1min":1.0069999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.9189999999999996},"last":1.5409999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6659999999999999,"5min":2.5630000000000002,"15min":3.2599999999999998},"min":{"1min":1.6619999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.407,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":3.2330000000000001},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.9670000000000001,"15min":3.2629999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":4.5839999999999996,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":2.089}]},{"osd":6,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":4.2519999999999998,"15min":3.9100000000000001},"min":{"1min":1.214,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":5.1479999999999997,"5min":44.954000000000001,"15min":44.954000000000001},"last":1.6890000000000001},{"interface":"front","average":{"1min":3.2869999999999999,"5min":4.6079999999999997,"15min":4.4809999999999999},"min":{"1min":1.9119999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":5.891,"5min":23.939,"15min":23.939},"last":3.367}]},{"osd":7,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":3.2149999999999999,"15min":3.5219999999999998},"min":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.429},"max":{"1min":4.2679999999999998,"5min":8.7919999999999998,"15min":8.7919999999999998},"last":2.1970000000000001},{"interface":"front","average":{"1min":2.4129999999999998,"5min":2.2269999999999999,"15min":3.0209999999999999},"min":{"1min":1.3939999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":5.2800000000000002,"5min":5.5839999999999996,"15min":5.5839999999999996},"last":1.8440000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":2.7890000000000001,"15min":3.633},"min":{"1min":1.97,"5min":1.49,"15min":1.49},"max":{"1min":5.1580000000000004,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":3.4980000000000002},{"interface":"front","average":{"1min":3.0489999999999999,"5min":3.3149999999999999,"15min":3.7069999999999999},"min":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"max":{"1min":5.1150000000000002,"5min":8.6669999999999998,"15min":8.6669999999999998},"last":2.3370000000000002}]},{"osd":9,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.6520000000000001,"5min":4.7000000000000002,"15min":4.891},"min":{"1min":2.274,"5min":1.9910000000000001,"15min":1.9910000000000001},"max":{"1min":6.3220000000000001,"5min":14.824999999999999,"15min":14.824999999999999},"last":3.6320000000000001},{"interface":"front","average":{"1min":3.8820000000000001,"5min":4.7560000000000002,"15min":4.6689999999999996},"min":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"max":{"1min":6.1459999999999999,"5min":12.275,"15min":12.275},"last":2.2730000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.194,"5min":2.9900000000000002,"15min":3.988},"min":{"1min":2.0209999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"max":{"1min":5.9359999999999999,"5min":7.5350000000000001,"15min":7.5350000000000001},"last":3.7709999999999999},{"interface":"front","average":{"1min":2.5209999999999999,"5min":2.2629999999999999,"15min":3.1749999999999998},"min":{"1min":1.387,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":5.4320000000000004,"5min":5.5309999999999997,"15min":6.1890000000000001},"last":1.974}]},{"osd":11,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":3.5009999999999999,"15min":4.077},"min":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"max":{"1min":5.3310000000000004,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":2.4020000000000001},{"interface":"front","average":{"1min":3.3410000000000002,"5min":3.109,"15min":4.2320000000000002},"min":{"1min":2.226,"5min":1.6319999999999999,"15min":1.6319999999999999},"max":{"1min":6.3250000000000002,"5min":7.4130000000000003,"15min":7.4130000000000003},"last":3.899}]}]},{"osd":4,"up_from":17,"seq":73014444137,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":916548,"kb_used_data":92783512,"kb_used_omap":32302,"kb_used_meta":0,"kb_avail":92782832,"statfs":{"total":95948165120,"available":95009619968,"internally_reserved":696320,"allocated":95010316288,"data_stored":95010316288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33077944,"internal_metadata":0},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.716,"15min":1.5760000000000001},"min":{"1min":0.68500000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9039999999999999,"5min":38.838000000000001,"15min":38.838000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2569999999999999,"15min":1.6100000000000001},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.6619999999999999,"5min":5.6539999999999999,"15min":8.3780000000000001},"last":1.292}]},{"osd":1,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84199999999999997,"15min":0.90800000000000003},"min":{"1min":0.66100000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.077,"5min":1.038,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.628,"15min":0.628},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1990000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2689999999999999,"15min":1.546},"min":{"1min":0.71399999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0219999999999998,"5min":4.298,"15min":4.298},"last":1.825},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.258,"15min":1.871},"min":{"1min":0.86199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.226,"5min":3.5880000000000001,"15min":8.8209999999999997},"last":1.6359999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.145,"15min":1.2470000000000001},"min":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.573,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.109,"15min":1.1140000000000001},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.897,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.4379999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.498,"15min":1.5449999999999999},"min":{"1min":0.85799999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.274,"5min":4.1840000000000002,"15min":5.4100000000000001},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.7410000000000001,"15min":1.8939999999999999},"min":{"1min":0.95399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.923,"5min":21.384,"15min":21.384},"last":1.4910000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3180000000000001,"15min":1.3440000000000001},"min":{"1min":1.038,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0609999999999999,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.53},"min":{"1min":0.76600000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.141,"5min":4.4390000000000001,"15min":8.6620000000000008},"last":1.583}]},{"osd":8,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2829999999999999,"15min":1.395},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.04,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.514,"15min":1.5920000000000001},"min":{"1min":1.1519999999999999,"5min":1.081,"15min":1.081},"max":{"1min":2.1909999999999998,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":1.6040000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.7490000000000001,"5min":2.0190000000000001,"15min":2.157},"min":{"1min":1.232,"5min":1.113,"15min":1.113},"max":{"1min":2.927,"5min":9.2119999999999997,"15min":9.2119999999999997},"last":2.0699999999999998},{"interface":"front","average":{"1min":1.8360000000000001,"5min":8.0169999999999995,"15min":5.3040000000000003},"min":{"1min":1.181,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":4.8109999999999999,"5min":310.995,"15min":332.43700000000001},"last":1.413}]},{"osd":10,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.625,"15min":1.9119999999999999},"min":{"1min":1.2549999999999999,"5min":1.143,"15min":1.143},"max":{"1min":2.5369999999999999,"5min":3.9380000000000002,"15min":8.2669999999999995},"last":1.736},{"interface":"front","average":{"1min":1.542,"5min":1.603,"15min":1.587},"min":{"1min":1.224,"5min":1.044,"15min":1.044},"max":{"1min":2.7250000000000001,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.9510000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4830000000000001,"15min":1.6160000000000001},"min":{"1min":1.115,"5min":1.018,"15min":1.018},"max":{"1min":2.7189999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.327},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.6839999999999999,"15min":1.9970000000000001},"min":{"1min":1.351,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.4289999999999998,"5min":3.8079999999999998,"15min":8.4329999999999998},"last":1.8540000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444136,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":843492,"kb_used_data":92856812,"kb_used_omap":17223,"kb_used_meta":0,"kb_avail":92855888,"statfs":{"total":95948165120,"available":95084429312,"internally_reserved":946176,"allocated":95085375488,"data_stored":95085375488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17636469,"internal_metadata":0},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.252,"15min":1.486},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.9750000000000001,"5min":6.4859999999999998,"15min":7.1699999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.153,"15min":1.319},"min":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":8.7669999999999995},"last":0.97399999999999998}]},{"osd":1,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.0029999999999999,"15min":1.036},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.1619999999999999,"5min":1.532,"15min":1.613},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.96799999999999997,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.63600000000000001},"max":{"1min":4.3010000000000002,"5min":4.3010000000000002,"15min":4.3010000000000002},"last":0.874}]},{"osd":2,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.294,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.4890000000000001,"15min":1.5680000000000001},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.085,"15min":1.1279999999999999},"min":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.8529999999999998,"5min":4.8529999999999998,"15min":4.8529999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.155,"5min":1.1899999999999999,"15min":1.2909999999999999},"min":{"1min":0.90900000000000003,"5min":0.879,"15min":0.879},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":3.3900000000000001},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.696,"15min":1.702},"min":{"1min":1.006,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":5.2489999999999997,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.835,"5min":1.7869999999999999,"15min":1.8340000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":6.5019999999999998,"5min":8.7279999999999998,"15min":8.7279999999999998},"last":1.409}]},{"osd":7,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":1.038,"5min":0.92900000000000005,"15min":0.86899999999999999},"max":{"1min":2.0379999999999998,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.997},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.377,"15min":1.429},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.98899999999999999},"max":{"1min":1.5289999999999999,"5min":1.911,"15min":2.3690000000000002},"last":1.1040000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.248,"15min":1.27},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":1.016},{"interface":"front","average":{"1min":1.403,"5min":1.486,"15min":1.53},"min":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.054},"max":{"1min":2.1680000000000001,"5min":2.254,"15min":2.254},"last":1.175}]},{"osd":9,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.8460000000000001,"15min":2.0179999999999998},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.5129999999999999,"5min":5.7599999999999998,"15min":5.7599999999999998},"last":1.319},{"interface":"front","average":{"1min":1.7,"5min":1.821,"15min":1.946},"min":{"1min":1.077,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":5.0780000000000003,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":1.153}]},{"osd":10,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.5760000000000001,"15min":1.6439999999999999},"min":{"1min":1.2869999999999999,"5min":1.23,"15min":1.23},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.262},{"interface":"front","average":{"1min":1.413,"5min":1.52,"15min":1.589},"min":{"1min":1.105,"5min":1.105,"15min":1.052},"max":{"1min":1.7450000000000001,"5min":2.0299999999999998,"15min":2.3719999999999999},"last":1.236}]},{"osd":11,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":5.016,"5min":5.016,"15min":5.016},"last":1.278},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6779999999999999,"15min":1.7450000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":2.2599999999999998,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.3380000000000001}]}]}]}} 2020-11-20T12:22:25.909 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:22:26.145 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.141+0000 7f59ef319700 1 Processor -- start 2020-11-20T12:22:26.146 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.141+0000 7f59ef319700 1 -- start start 2020-11-20T12:22:26.146 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.143+0000 7f59ef319700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e8061b80 con 0x7f59e80c4970 2020-11-20T12:22:26.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.143+0000 7f59ef319700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e8061e20 con 0x7f59e80616b0 2020-11-20T12:22:26.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.143+0000 7f59ef319700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e80620c0 con 0x7f59e80630b0 2020-11-20T12:22:26.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.143+0000 7f59ee317700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f59e80630b0 0x7f59e80bf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56178/0 (socket says 172.21.15.160:56178) 2020-11-20T12:22:26.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.143+0000 7f59ee317700 1 -- 172.21.15.160:0/346642467 learned_addr learned my addr 172.21.15.160:0/346642467 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:26.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.143+0000 7f59edb16700 1 --1- 172.21.15.160:0/346642467 >> v1:172.21.15.150:6789/0 conn(0x7f59e80616b0 0x7f59e80c4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47444/0 (socket says 172.21.15.160:47444) 2020-11-20T12:22:26.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088329691 0 0) 0x7f59e8061e20 con 0x7f59e80616b0 2020-11-20T12:22:26.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d0003240 con 0x7f59e80616b0 2020-11-20T12:22:26.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752855714 0 0) 0x7f59e8061b80 con 0x7f59e80c4970 2020-11-20T12:22:26.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e8061e20 con 0x7f59e80c4970 2020-11-20T12:22:26.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122642836 0 0) 0x7f59e80620c0 con 0x7f59e80630b0 2020-11-20T12:22:26.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e8061b80 con 0x7f59e80630b0 2020-11-20T12:22:26.152 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.2 v1:172.21.15.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3523490240 0 0) 0x7f59e8061b80 con 0x7f59e80630b0 2020-11-20T12:22:26.152 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 >> v1:172.21.15.150:6789/0 conn(0x7f59e80616b0 legacy=0x7f59e80c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.152 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 >> v1:172.21.15.134:6789/0 conn(0x7f59e80c4970 legacy=0x7f59e814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.152 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 --> v1:172.21.15.160:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8062360 con 0x7f59e80630b0 2020-11-20T12:22:26.152 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.144+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.2 v1:172.21.15.160:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4057041663 0 0) 0x7f59e4001900 con 0x7f59e80630b0 2020-11-20T12:22:26.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 >> v1:172.21.15.160:6789/0 conn(0x7f59e80630b0 legacy=0x7f59e80bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ed315700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d0004b00 0x7f59d0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:26.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ed315700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00034d0 0x7f59d0003950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:26.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ed315700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59d0003f30 0x7f59d000b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:26.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d000bc70 con 0x7f59d0003f30 2020-11-20T12:22:26.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d000bde0 con 0x7f59d00034d0 2020-11-20T12:22:26.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d000bfa0 con 0x7f59d0004b00 2020-11-20T12:22:26.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59ee317700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d0004b00 0x7f59d0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:26.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59edb16700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00034d0 0x7f59d0003950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:26.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.145+0000 7f59eeb18700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59d0003f30 0x7f59d000b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:26.155 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ee317700 1 -- 172.21.15.160:0/346642467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00034d0 msgr2=0x7f59d0003950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:26.155 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ee317700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59d00034d0 0x7f59d0003950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.155 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ee317700 1 -- 172.21.15.160:0/346642467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59d0003f30 msgr2=0x7f59d000b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:26.155 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ee317700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59d0003f30 0x7f59d000b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.155 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ee317700 1 -- 172.21.15.160:0/346642467 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8061b80 con 0x7f59d0004b00 2020-11-20T12:22:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59eeb18700 1 -- 172.21.15.160:0/346642467 reap_dead start 2020-11-20T12:22:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ee317700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d0004b00 0x7f59d0004f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f59e400c580 tx=0x7f59e8061fb0).ready entity=mon.2 client_cookie=c43f67c62c71ab06 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4005a50 con 0x7f59d0004b00 2020-11-20T12:22:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4005bd0 con 0x7f59d0004b00 2020-11-20T12:22:26.156 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.146+0000 7f59ed315700 1 -- 172.21.15.160:0/346642467 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40070d0 con 0x7f59d0004b00 2020-11-20T12:22:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.147+0000 7f59ef319700 1 -- 172.21.15.160:0/346642467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d0004b00 msgr2=0x7f59d0004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.147+0000 7f59ef319700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d0004b00 0x7f59d0004f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f59e400c580 tx=0x7f59e8061fb0).stop 2020-11-20T12:22:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.147+0000 7f59ef319700 1 -- 172.21.15.160:0/346642467 shutdown_connections 2020-11-20T12:22:26.157 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.147+0000 7f59ef319700 1 --2- 172.21.15.160:0/346642467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59d0004b00 0x7f59d0004f00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.147+0000 7f59ef319700 1 -- 172.21.15.160:0/346642467 >> 172.21.15.160:0/346642467 conn(0x7f59e8060140 msgr2=0x7f59e8060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:26.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.147+0000 7f59ef319700 1 -- 172.21.15.160:0/346642467 shutdown_connections 2020-11-20T12:22:26.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.147+0000 7f59ef319700 1 -- 172.21.15.160:0/346642467 wait complete. 2020-11-20T12:22:26.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.148+0000 7f59ef319700 1 Processor -- start 2020-11-20T12:22:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.149+0000 7f59ef319700 1 -- start start 2020-11-20T12:22:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.149+0000 7f59ef319700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80c1eb0 0x7f59e80c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.149+0000 7f59ef319700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59e80c5bf0 0x7f59e814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:26.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.149+0000 7f59ef319700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e814e250 0x7f59e8146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.149+0000 7f59ef319700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e814e690 con 0x7f59e80c5bf0 2020-11-20T12:22:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ef319700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e8160500 con 0x7f59e80c1eb0 2020-11-20T12:22:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ef319700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e81607a0 con 0x7f59e814e250 2020-11-20T12:22:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59eeb18700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e814e250 0x7f59e8146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:26.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59edb16700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59e80c5bf0 0x7f59e814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59edb16700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59e80c5bf0 0x7f59e814dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:32902/0 (socket says 172.21.15.160:32902) 2020-11-20T12:22:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ee317700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80c1eb0 0x7f59e80c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59edb16700 1 -- 172.21.15.160:0/876093780 learned_addr learned my addr 172.21.15.160:0/876093780 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ee317700 1 -- 172.21.15.160:0/876093780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e814e250 msgr2=0x7f59e8146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ee317700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e814e250 0x7f59e8146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ee317700 1 -- 172.21.15.160:0/876093780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59e80c5bf0 msgr2=0x7f59e814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ee317700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59e80c5bf0 0x7f59e814dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.150+0000 7f59ee317700 1 -- 172.21.15.160:0/876093780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8160a40 con 0x7f59e80c1eb0 2020-11-20T12:22:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.151+0000 7f59ee317700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80c1eb0 0x7f59e80c2290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f59e4012000 tx=0x7f59e4013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:26.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.151+0000 7f59d67fc700 1 -- 172.21.15.160:0/876093780 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40012b0 con 0x7f59e80c1eb0 2020-11-20T12:22:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.151+0000 7f59d67fc700 1 -- 172.21.15.160:0/876093780 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4001a50 con 0x7f59e80c1eb0 2020-11-20T12:22:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.151+0000 7f59d67fc700 1 -- 172.21.15.160:0/876093780 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e401f6c0 con 0x7f59e80c1eb0 2020-11-20T12:22:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.151+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e8160ce0 con 0x7f59e80c1eb0 2020-11-20T12:22:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.151+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e8161220 con 0x7f59e80c1eb0 2020-11-20T12:22:26.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.152+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e8044f60 con 0x7f59e80c1eb0 2020-11-20T12:22:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.154+0000 7f59d67fc700 1 -- 172.21.15.160:0/876093780 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f59e401c070 con 0x7f59e80c1eb0 2020-11-20T12:22:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.154+0000 7f59d67fc700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59c0080630 0x7f59c0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.155+0000 7f59d67fc700 1 -- 172.21.15.160:0/876093780 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f59e40a3a30 con 0x7f59e80c1eb0 2020-11-20T12:22:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.155+0000 7f59edb16700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59c0080630 0x7f59c0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:26.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.155+0000 7f59edb16700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59c0080630 0x7f59c0082af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f59d8007fd0 tx=0x7f59d8007b80).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:26.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.157+0000 7f59d67fc700 1 -- 172.21.15.160:0/876093780 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f59e4078560 con 0x7f59e80c1eb0 2020-11-20T12:22:26.343 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.340+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59e8060d50 con 0x7f59e80c1eb0 2020-11-20T12:22:26.345 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.342+0000 7f59d67fc700 1 -- 172.21.15.160:0/876093780 <== mon.1 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+21582 (secure 0 0 0) 0x7f59e4024020 con 0x7f59e80c1eb0 2020-11-20T12:22:26.346 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:22:26.346 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":26,"fsid":"9013b66f-4346-4464-9f02-9fb5fd49fe5a","created":"2020-11-20T12:13:50.679655+0000","modified":"2020-11-20T12:14:11.880090+0000","last_up_change":"2020-11-20T12:13:57.753933+0000","last_in_change":"2020-11-20T12:13:57.753933+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:13:54.112655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:04.811782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:08.565233+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:09.890329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"533335c8-3a56-4df0-b5c8-b35679ee5b5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":17044},{"type":"v1","addr":"172.21.15.160:6806","nonce":17044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":17044},{"type":"v1","addr":"172.21.15.160:6810","nonce":17044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":17044},{"type":"v1","addr":"172.21.15.160:6815","nonce":17044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":17044},{"type":"v1","addr":"172.21.15.160:6813","nonce":17044}]},"public_addr":"172.21.15.160:6806/17044","cluster_addr":"172.21.15.160:6810/17044","heartbeat_back_addr":"172.21.15.160:6815/17044","heartbeat_front_addr":"172.21.15.160:6813/17044","state":["exists","up"]},{"osd":1,"uuid":"69c7220e-b7d5-4197-bb17-6b52f7426847","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":21742},{"type":"v1","addr":"172.21.15.150:6803","nonce":21742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":21742},{"type":"v1","addr":"172.21.15.150:6805","nonce":21742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":21742},{"type":"v1","addr":"172.21.15.150:6809","nonce":21742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":21742},{"type":"v1","addr":"172.21.15.150:6807","nonce":21742}]},"public_addr":"172.21.15.150:6803/21742","cluster_addr":"172.21.15.150:6805/21742","heartbeat_back_addr":"172.21.15.150:6809/21742","heartbeat_front_addr":"172.21.15.150:6807/21742","state":["exists","up"]},{"osd":2,"uuid":"5b83f099-523f-456e-875b-6f7c9997e306","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":22183},{"type":"v1","addr":"172.21.15.134:6801","nonce":22183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":22183},{"type":"v1","addr":"172.21.15.134:6803","nonce":22183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":22183},{"type":"v1","addr":"172.21.15.134:6807","nonce":22183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":22183},{"type":"v1","addr":"172.21.15.134:6805","nonce":22183}]},"public_addr":"172.21.15.134:6801/22183","cluster_addr":"172.21.15.134:6803/22183","heartbeat_back_addr":"172.21.15.134:6807/22183","heartbeat_front_addr":"172.21.15.134:6805/22183","state":["exists","up"]},{"osd":3,"uuid":"122cf4f5-d499-4e71-b5d1-9b7bbb61b2fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":17043},{"type":"v1","addr":"172.21.15.160:6801","nonce":17043}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":17043},{"type":"v1","addr":"172.21.15.160:6803","nonce":17043}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6809","nonce":17043},{"type":"v1","addr":"172.21.15.160:6811","nonce":17043}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6805","nonce":17043},{"type":"v1","addr":"172.21.15.160:6807","nonce":17043}]},"public_addr":"172.21.15.160:6801/17043","cluster_addr":"172.21.15.160:6803/17043","heartbeat_back_addr":"172.21.15.160:6811/17043","heartbeat_front_addr":"172.21.15.160:6807/17043","state":["exists","up"]},{"osd":4,"uuid":"4766f07e-9808-49dc-b08e-8abda95ac061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":21785},{"type":"v1","addr":"172.21.15.150:6819","nonce":21785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":21785},{"type":"v1","addr":"172.21.15.150:6821","nonce":21785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6825","nonce":21785},{"type":"v1","addr":"172.21.15.150:6827","nonce":21785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":21785},{"type":"v1","addr":"172.21.15.150:6823","nonce":21785}]},"public_addr":"172.21.15.150:6819/21785","cluster_addr":"172.21.15.150:6821/21785","heartbeat_back_addr":"172.21.15.150:6827/21785","heartbeat_front_addr":"172.21.15.150:6823/21785","state":["exists","up"]},{"osd":5,"uuid":"4ad696e2-6079-4d68-a4d4-820e0f60dc30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":22195},{"type":"v1","addr":"172.21.15.134:6817","nonce":22195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":22195},{"type":"v1","addr":"172.21.15.134:6819","nonce":22195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":22195},{"type":"v1","addr":"172.21.15.134:6823","nonce":22195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":22195},{"type":"v1","addr":"172.21.15.134:6821","nonce":22195}]},"public_addr":"172.21.15.134:6817/22195","cluster_addr":"172.21.15.134:6819/22195","heartbeat_back_addr":"172.21.15.134:6823/22195","heartbeat_front_addr":"172.21.15.134:6821/22195","state":["exists","up"]},{"osd":6,"uuid":"68ef137b-dfa9-44ff-8de5-17008704111d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":17072},{"type":"v1","addr":"172.21.15.160:6819","nonce":17072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6821","nonce":17072},{"type":"v1","addr":"172.21.15.160:6823","nonce":17072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6829","nonce":17072},{"type":"v1","addr":"172.21.15.160:6831","nonce":17072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6825","nonce":17072},{"type":"v1","addr":"172.21.15.160:6827","nonce":17072}]},"public_addr":"172.21.15.160:6819/17072","cluster_addr":"172.21.15.160:6823/17072","heartbeat_back_addr":"172.21.15.160:6831/17072","heartbeat_front_addr":"172.21.15.160:6827/17072","state":["exists","up"]},{"osd":7,"uuid":"2ccbc6ef-df7b-476a-93b4-2557d2b0c120","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":21826},{"type":"v1","addr":"172.21.15.150:6826","nonce":21826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":21826},{"type":"v1","addr":"172.21.15.150:6829","nonce":21826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":21826},{"type":"v1","addr":"172.21.15.150:6833","nonce":21826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":21826},{"type":"v1","addr":"172.21.15.150:6831","nonce":21826}]},"public_addr":"172.21.15.150:6826/21826","cluster_addr":"172.21.15.150:6829/21826","heartbeat_back_addr":"172.21.15.150:6833/21826","heartbeat_front_addr":"172.21.15.150:6831/21826","state":["exists","up"]},{"osd":8,"uuid":"c53a8cc0-f906-4ecd-b0ba-b5d2f1e485e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":22184},{"type":"v1","addr":"172.21.15.134:6809","nonce":22184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":22184},{"type":"v1","addr":"172.21.15.134:6811","nonce":22184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":22184},{"type":"v1","addr":"172.21.15.134:6815","nonce":22184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":22184},{"type":"v1","addr":"172.21.15.134:6813","nonce":22184}]},"public_addr":"172.21.15.134:6809/22184","cluster_addr":"172.21.15.134:6811/22184","heartbeat_back_addr":"172.21.15.134:6815/22184","heartbeat_front_addr":"172.21.15.134:6813/22184","state":["exists","up"]},{"osd":9,"uuid":"3e6b4d8b-aa11-45ae-a917-b52b3893997b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6817","nonce":17065},{"type":"v1","addr":"172.21.15.160:6818","nonce":17065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":17065},{"type":"v1","addr":"172.21.15.160:6822","nonce":17065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":17065},{"type":"v1","addr":"172.21.15.160:6830","nonce":17065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":17065},{"type":"v1","addr":"172.21.15.160:6826","nonce":17065}]},"public_addr":"172.21.15.160:6818/17065","cluster_addr":"172.21.15.160:6822/17065","heartbeat_back_addr":"172.21.15.160:6830/17065","heartbeat_front_addr":"172.21.15.160:6826/17065","state":["exists","up"]},{"osd":10,"uuid":"c447a333-a662-470d-9ba6-31bbca719e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":21743},{"type":"v1","addr":"172.21.15.150:6811","nonce":21743}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":21743},{"type":"v1","addr":"172.21.15.150:6813","nonce":21743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":21743},{"type":"v1","addr":"172.21.15.150:6817","nonce":21743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":21743},{"type":"v1","addr":"172.21.15.150:6815","nonce":21743}]},"public_addr":"172.21.15.150:6811/21743","cluster_addr":"172.21.15.150:6813/21743","heartbeat_back_addr":"172.21.15.150:6817/21743","heartbeat_front_addr":"172.21.15.150:6815/21743","state":["exists","up"]},{"osd":11,"uuid":"ef60d791-08b7-4edc-991b-be018728ea35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":22225},{"type":"v1","addr":"172.21.15.134:6825","nonce":22225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":22225},{"type":"v1","addr":"172.21.15.134:6827","nonce":22225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":22225},{"type":"v1","addr":"172.21.15.134:6831","nonce":22225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":22225},{"type":"v1","addr":"172.21.15.134:6829","nonce":22225}]},"public_addr":"172.21.15.134:6825/22225","cluster_addr":"172.21.15.134:6827/22225","heartbeat_back_addr":"172.21.15.134:6831/22225","heartbeat_front_addr":"172.21.15.134:6829/22225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.000120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.863086+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.877151+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.951293+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.939488+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.927520+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.069060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.960590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.909231+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:56.003955+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.884592+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:13:55.940044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:22:26.347 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59c0080630 msgr2=0x7f59c0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59c0080630 0x7f59c0082af0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f59d8007fd0 tx=0x7f59d8007b80).stop 2020-11-20T12:22:26.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80c1eb0 msgr2=0x7f59e80c2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:26.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80c1eb0 0x7f59e80c2290 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f59e4012000 tx=0x7f59e4013000).stop 2020-11-20T12:22:26.348 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 shutdown_connections 2020-11-20T12:22:26.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f59c0080630 0x7f59c0082af0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59e814e250 0x7f59e8146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f59e80c1eb0 0x7f59e80c2290 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 --2- 172.21.15.160:0/876093780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59e80c5bf0 0x7f59e814dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:26.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 >> 172.21.15.160:0/876093780 conn(0x7f59e8060140 msgr2=0x7f59e805ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:26.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.344+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 shutdown_connections 2020-11-20T12:22:26.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:26.345+0000 7f59ef319700 1 -- 172.21.15.160:0/876093780 wait complete. 2020-11-20T12:22:27.370 INFO:tasks.ceph:Scrubbing osd.0 2020-11-20T12:22:27.371 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:27.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.611+0000 7fb4c1893700 1 Processor -- start 2020-11-20T12:22:27.614 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.611+0000 7fb4c1893700 1 -- start start 2020-11-20T12:22:27.616 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c1893700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb4bc0c3e30 0x7fb4bc0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.616 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c1893700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4bc0627c0 0x7fb4bc0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c1893700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4bc064e10 con 0x7fb4bc150cb0 2020-11-20T12:22:27.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c1893700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc065e90 con 0x7fb4bc0c3e30 2020-11-20T12:22:27.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c1893700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4bc151540 con 0x7fb4bc0627c0 2020-11-20T12:22:27.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4bbfff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb4bc0627c0 0x7fb4bc0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.617 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c1092700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb4bc150cb0 0x7fb4bc065780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47464/0 (socket says 172.21.15.160:47464) 2020-11-20T12:22:27.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c1092700 1 -- 172.21.15.160:0/1241860970 learned_addr learned my addr 172.21.15.160:0/1241860970 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:27.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.613+0000 7fb4c0891700 1 --2- 172.21.15.160:0/1241860970 >> v2:172.21.15.134:3300/0 conn(0x7fb4bc0c3e30 0x7fb4bc0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bbfff700 1 -- 172.21.15.160:0/1241860970 >> v2:172.21.15.134:3300/0 conn(0x7fb4bc0c3e30 msgr2=0x7fb4bc0c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:27.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bbfff700 1 --2- 172.21.15.160:0/1241860970 >> v2:172.21.15.134:3300/0 conn(0x7fb4bc0c3e30 0x7fb4bc0c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bbfff700 1 -- 172.21.15.160:0/1241860970 >> v1:172.21.15.150:6789/0 conn(0x7fb4bc150cb0 legacy=0x7fb4bc065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bb7fe700 1 -- 172.21.15.160:0/1241860970 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554235453 0 0) 0x7fb4bc064e10 con 0x7fb4bc150cb0 2020-11-20T12:22:27.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bbfff700 1 -- 172.21.15.160:0/1241860970 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc1517e0 con 0x7fb4bc0627c0 2020-11-20T12:22:27.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bbfff700 1 --2- 172.21.15.160:0/1241860970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc0c4210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb4bc0c4ec0 tx=0x7fb4a8006df0).ready entity=mon.1 client_cookie=82926e632cd2e318 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:27.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bb7fe700 1 -- 172.21.15.160:0/1241860970 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80097b0 con 0x7fb4bc0627c0 2020-11-20T12:22:27.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bb7fe700 1 -- 172.21.15.160:0/1241860970 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8009910 con 0x7fb4bc0627c0 2020-11-20T12:22:27.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.614+0000 7fb4bb7fe700 1 -- 172.21.15.160:0/1241860970 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8009c90 con 0x7fb4bc0627c0 2020-11-20T12:22:27.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 -- 172.21.15.160:0/1241860970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc0627c0 msgr2=0x7fb4bc0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 --2- 172.21.15.160:0/1241860970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc0c4210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fb4bc0c4ec0 tx=0x7fb4a8006df0).stop 2020-11-20T12:22:27.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 -- 172.21.15.160:0/1241860970 shutdown_connections 2020-11-20T12:22:27.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 --2- 172.21.15.160:0/1241860970 >> v2:172.21.15.134:3300/0 conn(0x7fb4bc0c3e30 0x7fb4bc0c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 --2- 172.21.15.160:0/1241860970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc0c4210 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 -- 172.21.15.160:0/1241860970 >> 172.21.15.160:0/1241860970 conn(0x7fb4bc062ed0 msgr2=0x7fb4bc0632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:27.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 -- 172.21.15.160:0/1241860970 shutdown_connections 2020-11-20T12:22:27.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.615+0000 7fb4c1893700 1 -- 172.21.15.160:0/1241860970 wait complete. 2020-11-20T12:22:27.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.616+0000 7fb4c1893700 1 Processor -- start 2020-11-20T12:22:27.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.617+0000 7fb4c1893700 1 -- start start 2020-11-20T12:22:27.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.617+0000 7fb4c1893700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.617+0000 7fb4c1893700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc0c3e30 0x7fb4bc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c1893700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc150cb0 0x7fb4bc153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c1893700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc153ff0 con 0x7fb4bc0c3e30 2020-11-20T12:22:27.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c1893700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc154290 con 0x7fb4bc150cb0 2020-11-20T12:22:27.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c1893700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4bc154530 con 0x7fb4bc0627c0 2020-11-20T12:22:27.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc1575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38624/0 (socket says 172.21.15.160:38624) 2020-11-20T12:22:27.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 -- 172.21.15.160:0/1512106641 learned_addr learned my addr 172.21.15.160:0/1512106641 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:27.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4bbfff700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc0c3e30 0x7fb4bc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c1092700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc150cb0 0x7fb4bc153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 -- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc150cb0 msgr2=0x7fb4bc153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4bc150cb0 0x7fb4bc153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 -- 172.21.15.160:0/1512106641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc0c3e30 msgr2=0x7fb4bc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4bc0c3e30 0x7fb4bc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.618+0000 7fb4c0891700 1 -- 172.21.15.160:0/1512106641 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc1547d0 con 0x7fb4bc0627c0 2020-11-20T12:22:27.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.619+0000 7fb4c0891700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc1575c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb4b000eba0 tx=0x7fb4b0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:27.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.619+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000c8e0 con 0x7fb4bc0627c0 2020-11-20T12:22:27.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.619+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b000ca40 con 0x7fb4bc0627c0 2020-11-20T12:22:27.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.619+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc154a70 con 0x7fb4bc0627c0 2020-11-20T12:22:27.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.619+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b000cdc0 con 0x7fb4bc0627c0 2020-11-20T12:22:27.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.619+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4bc153c90 con 0x7fb4bc0627c0 2020-11-20T12:22:27.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.620+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4bc069460 con 0x7fb4bc0627c0 2020-11-20T12:22:27.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.621+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb4b0012600 con 0x7fb4bc0627c0 2020-11-20T12:22:27.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.622+0000 7fb4b8ff9700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb494080630 0x7fb494082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.622+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fb4b00a2c70 con 0x7fb4bc0627c0 2020-11-20T12:22:27.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.622+0000 7fb4b8ff9700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7fb494088cd0 0x7fb49408b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.622+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 --> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb49408b750 con 0x7fb494088cd0 2020-11-20T12:22:27.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.622+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4b00a7030 con 0x7fb4bc0627c0 2020-11-20T12:22:27.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.622+0000 7fb4bbfff700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb494080630 0x7fb494082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.623+0000 7fb4c1092700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7fb494088cd0 0x7fb49408b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.623+0000 7fb4bbfff700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb494080630 0x7fb494082af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb4a8006e30 tx=0x7fb4a8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:27.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.623+0000 7fb4c1092700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7fb494088cd0 0x7fb49408b0f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:27.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.624+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== osd.0 v2:172.21.15.160:6804/17044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fb49408b750 con 0x7fb494088cd0 2020-11-20T12:22:27.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.651+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 --> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4bc05c510 con 0x7fb494088cd0 2020-11-20T12:22:27.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.652+0000 7fb4b8ff9700 1 -- 172.21.15.160:0/1512106641 <== osd.0 v2:172.21.15.160:6804/17044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb4bc05c510 con 0x7fb494088cd0 2020-11-20T12:22:27.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7fb494088cd0 msgr2=0x7fb49408b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:6804/17044,v1:172.21.15.160:6806/17044] conn(0x7fb494088cd0 0x7fb49408b0f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb494080630 msgr2=0x7fb494082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb494080630 0x7fb494082af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb4a8006e30 tx=0x7fb4a8015000).stop 2020-11-20T12:22:27.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0627c0 msgr2=0x7fb4bc1575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 --2- 172.21.15.160:0/1512106641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4bc0627c0 0x7fb4bc1575c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb4b000eba0 tx=0x7fb4b0006df0).stop 2020-11-20T12:22:27.657 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:27.657 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:27.658 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:27.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1092700 1 -- 172.21.15.160:0/1512106641 reap_dead start 2020-11-20T12:22:27.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 shutdown_connections 2020-11-20T12:22:27.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 >> 172.21.15.160:0/1512106641 conn(0x7fb4bc062ed0 msgr2=0x7fb4bc0c2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:27.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 shutdown_connections 2020-11-20T12:22:27.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.653+0000 7fb4c1893700 1 -- 172.21.15.160:0/1512106641 wait complete. 2020-11-20T12:22:27.675 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2020-11-20T12:22:27.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.905+0000 7f31a359e700 1 Processor -- start 2020-11-20T12:22:27.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.905+0000 7f31a359e700 1 -- start start 2020-11-20T12:22:27.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a359e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31a414f590 0x7f31a4065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a359e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a40bfbc0 con 0x7f31a40bcb00 2020-11-20T12:22:27.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a359e700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a414ebf0 con 0x7f31a40bc720 2020-11-20T12:22:27.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a359e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a4065eb0 con 0x7f31a414f590 2020-11-20T12:22:27.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a2d9d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f31a414f590 0x7f31a4065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a1d9b700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f31a40bcb00 0x7f31a40bd8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60946/0 (socket says 172.21.15.160:60946) 2020-11-20T12:22:27.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a1d9b700 1 -- 172.21.15.160:0/2403462009 learned_addr learned my addr 172.21.15.160:0/2403462009 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:27.915 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.907+0000 7f31a259c700 1 --1- 172.21.15.160:0/2403462009 >> v1:172.21.15.150:6789/0 conn(0x7f31a40bc720 0x7f31a40bf4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47478/0 (socket says 172.21.15.160:47478) 2020-11-20T12:22:27.916 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a2d9d700 1 -- 172.21.15.160:0/2403462009 >> v1:172.21.15.150:6789/0 conn(0x7f31a40bc720 legacy=0x7f31a40bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.916 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a159a700 1 -- 172.21.15.160:0/2403462009 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257023493 0 0) 0x7f31a414ebf0 con 0x7f31a40bc720 2020-11-20T12:22:27.917 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a2d9d700 1 -- 172.21.15.160:0/2403462009 >> v1:172.21.15.134:6789/0 conn(0x7f31a40bcb00 legacy=0x7f31a40bd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.917 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a2d9d700 1 -- 172.21.15.160:0/2403462009 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a414f9e0 con 0x7f31a414f590 2020-11-20T12:22:27.917 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a2d9d700 1 --2- 172.21.15.160:0/2403462009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a4065200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f319c009c90 tx=0x7f319c0091d0).ready entity=mon.0 client_cookie=f73e2126c2f05a05 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:27.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a159a700 1 -- 172.21.15.160:0/2403462009 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c00bbc0 con 0x7f31a414f590 2020-11-20T12:22:27.918 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a159a700 1 -- 172.21.15.160:0/2403462009 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c00bd20 con 0x7f31a414f590 2020-11-20T12:22:27.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.908+0000 7f31a159a700 1 -- 172.21.15.160:0/2403462009 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c011610 con 0x7f31a414f590 2020-11-20T12:22:27.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.909+0000 7f31a359e700 1 -- 172.21.15.160:0/2403462009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 msgr2=0x7f31a4065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.919 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.909+0000 7f31a359e700 1 --2- 172.21.15.160:0/2403462009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a4065200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f319c009c90 tx=0x7f319c0091d0).stop 2020-11-20T12:22:27.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.909+0000 7f31a359e700 1 -- 172.21.15.160:0/2403462009 shutdown_connections 2020-11-20T12:22:27.920 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.909+0000 7f31a359e700 1 --2- 172.21.15.160:0/2403462009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a4065200 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.909+0000 7f31a359e700 1 -- 172.21.15.160:0/2403462009 >> 172.21.15.160:0/2403462009 conn(0x7f31a4062ef0 msgr2=0x7f31a4063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:27.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.909+0000 7f31a359e700 1 -- 172.21.15.160:0/2403462009 shutdown_connections 2020-11-20T12:22:27.921 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.909+0000 7f31a359e700 1 -- 172.21.15.160:0/2403462009 wait complete. 2020-11-20T12:22:27.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.911+0000 7f31a359e700 1 Processor -- start 2020-11-20T12:22:27.927 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.911+0000 7f31a359e700 1 -- start start 2020-11-20T12:22:27.928 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a359e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a40bc720 0x7f31a4156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.929 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31a40bcb00 0x7f31a414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.929 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a359e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a414a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.929 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a359e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a40c37e0 con 0x7f31a414f590 2020-11-20T12:22:27.929 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a359e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a41648b0 con 0x7f31a40bc720 2020-11-20T12:22:27.930 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a359e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a4153f30 con 0x7f31a40bcb00 2020-11-20T12:22:27.930 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a40bc720 0x7f31a4156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.930 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a2d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a414a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.930 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a259c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a40bc720 0x7f31a4156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51776/0 (socket says 172.21.15.160:51776) 2020-11-20T12:22:27.930 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a259c700 1 -- 172.21.15.160:0/2539949616 learned_addr learned my addr 172.21.15.160:0/2539949616 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:27.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.912+0000 7f31a1d9b700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31a40bcb00 0x7f31a414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31a2d9d700 1 -- 172.21.15.160:0/2539949616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31a40bcb00 msgr2=0x7f31a414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31a2d9d700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31a40bcb00 0x7f31a414a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.931 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31a2d9d700 1 -- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a40bc720 msgr2=0x7f31a4156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:27.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31a2d9d700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a40bc720 0x7f31a4156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:27.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31a2d9d700 1 -- 172.21.15.160:0/2539949616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a41541d0 con 0x7f31a414f590 2020-11-20T12:22:27.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31a259c700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a40bc720 0x7f31a4156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:22:27.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31a2d9d700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a414a980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f319c013000 tx=0x7f319c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:27.932 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.913+0000 7f31927fc700 1 -- 172.21.15.160:0/2539949616 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c010800 con 0x7f31a414f590 2020-11-20T12:22:27.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.914+0000 7f31927fc700 1 -- 172.21.15.160:0/2539949616 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c010960 con 0x7f31a414f590 2020-11-20T12:22:27.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.914+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a4154470 con 0x7f31a414f590 2020-11-20T12:22:27.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.914+0000 7f31927fc700 1 -- 172.21.15.160:0/2539949616 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c010ce0 con 0x7f31a414f590 2020-11-20T12:22:27.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.914+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a40c1190 con 0x7f31a414f590 2020-11-20T12:22:27.933 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.915+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a4044f60 con 0x7f31a414f590 2020-11-20T12:22:27.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.916+0000 7f31927fc700 1 -- 172.21.15.160:0/2539949616 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f319c024030 con 0x7f31a414f590 2020-11-20T12:22:27.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.917+0000 7f31927fc700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3178080630 0x7f3178082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:27.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.917+0000 7f31927fc700 1 -- 172.21.15.160:0/2539949616 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f319c0a4a90 con 0x7f31a414f590 2020-11-20T12:22:27.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.917+0000 7f31a259c700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3178080630 0x7f3178082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:27.934 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.918+0000 7f31a259c700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3178080630 0x7f3178082af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f31940011a0 tx=0x7f3194007120).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:27.935 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:27.919+0000 7f31927fc700 1 -- 172.21.15.160:0/2539949616 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f319c079600 con 0x7f31a414f590 2020-11-20T12:22:28.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.105+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f31a4149e70 con 0x7f3178080630 2020-11-20T12:22:28.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.105+0000 7f31927fc700 1 -- 172.21.15.160:0/2539949616 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3194007c20 con 0x7f3178080630 2020-11-20T12:22:28.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.107+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3178080630 msgr2=0x7f3178082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.107+0000 7f31a359e700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3178080630 0x7f3178082af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f31940011a0 tx=0x7f3194007120).stop 2020-11-20T12:22:28.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.107+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 msgr2=0x7f31a414a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.107+0000 7f31a359e700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a414a980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f319c013000 tx=0x7f319c016000).stop 2020-11-20T12:22:28.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 shutdown_connections 2020-11-20T12:22:28.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f3178080630 0x7f3178082af0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a414f590 0x7f31a414a980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a40bc720 0x7f31a4156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 --2- 172.21.15.160:0/2539949616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31a40bcb00 0x7f31a414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 >> 172.21.15.160:0/2539949616 conn(0x7f31a4062ef0 msgr2=0x7f31a40c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:28.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 shutdown_connections 2020-11-20T12:22:28.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.108+0000 7f31a359e700 1 -- 172.21.15.160:0/2539949616 wait complete. 2020-11-20T12:22:28.118 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 0 to deep-scrub 2020-11-20T12:22:28.134 INFO:tasks.ceph:Scrubbing osd.3 2020-11-20T12:22:28.135 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:28.370 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.367+0000 7f94be6d3700 1 Processor -- start 2020-11-20T12:22:28.371 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.367+0000 7f94be6d3700 1 -- start start 2020-11-20T12:22:28.373 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.369+0000 7f94be6d3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f94b8061870 0x7f94b8061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.373 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.369+0000 7f94be6d3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f94b80bae80 0x7f94b80bb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.373 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.369+0000 7f94be6d3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f94b8063ee0 0x7f94b8064360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.374 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.369+0000 7f94be6d3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80bb7d0 con 0x7f94b8063ee0 2020-11-20T12:22:28.374 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.369+0000 7f94be6d3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80bbd20 con 0x7f94b80bae80 2020-11-20T12:22:28.374 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.369+0000 7f94be6d3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80bbfc0 con 0x7f94b8061870 2020-11-20T12:22:28.374 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.369+0000 7f94bd6d1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f94b8061870 0x7f94b8061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.375 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f94b8061870 0x7f94b8061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38648/0 (socket says 172.21.15.160:38648) 2020-11-20T12:22:28.375 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 -- 172.21.15.160:0/916728883 learned_addr learned my addr 172.21.15.160:0/916728883 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:28.375 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bced0700 1 --2- 172.21.15.160:0/916728883 >> v2:172.21.15.150:3300/0 conn(0x7f94b80bae80 0x7f94b80bb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.376 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bded2700 1 --2- 172.21.15.160:0/916728883 >> v2:172.21.15.134:3300/0 conn(0x7f94b8063ee0 0x7f94b8064360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.376 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 -- 172.21.15.160:0/916728883 >> v2:172.21.15.150:3300/0 conn(0x7f94b80bae80 msgr2=0x7f94b80bb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:28.376 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 --2- 172.21.15.160:0/916728883 >> v2:172.21.15.150:3300/0 conn(0x7f94b80bae80 0x7f94b80bb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.376 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 -- 172.21.15.160:0/916728883 >> v2:172.21.15.134:3300/0 conn(0x7f94b8063ee0 msgr2=0x7f94b8064360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:28.377 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 --2- 172.21.15.160:0/916728883 >> v2:172.21.15.134:3300/0 conn(0x7f94b8063ee0 0x7f94b8064360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.377 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 -- 172.21.15.160:0/916728883 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80bc260 con 0x7f94b8061870 2020-11-20T12:22:28.380 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.370+0000 7f94bd6d1700 1 --2- 172.21.15.160:0/916728883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b8061870 0x7f94b8061c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f94b805c470 tx=0x7f94b4009290).ready entity=mon.2 client_cookie=d3d81a0751ccc675 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:28.380 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94a7fff700 1 -- 172.21.15.160:0/916728883 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b400bbc0 con 0x7f94b8061870 2020-11-20T12:22:28.381 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94a7fff700 1 -- 172.21.15.160:0/916728883 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b400bd20 con 0x7f94b8061870 2020-11-20T12:22:28.381 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94a7fff700 1 -- 172.21.15.160:0/916728883 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4011610 con 0x7f94b8061870 2020-11-20T12:22:28.381 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 -- 172.21.15.160:0/916728883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b8061870 msgr2=0x7f94b8061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.381 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 --2- 172.21.15.160:0/916728883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b8061870 0x7f94b8061c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f94b805c470 tx=0x7f94b4009290).stop 2020-11-20T12:22:28.382 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 -- 172.21.15.160:0/916728883 shutdown_connections 2020-11-20T12:22:28.382 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 --2- 172.21.15.160:0/916728883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b8061870 0x7f94b8061c50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.382 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 --2- 172.21.15.160:0/916728883 >> v2:172.21.15.134:3300/0 conn(0x7f94b8063ee0 0x7f94b8064360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.382 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 --2- 172.21.15.160:0/916728883 >> v2:172.21.15.150:3300/0 conn(0x7f94b80bae80 0x7f94b80bb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.383 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 -- 172.21.15.160:0/916728883 >> 172.21.15.160:0/916728883 conn(0x7f94b80c2f70 msgr2=0x7f94b80c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:28.383 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.371+0000 7f94be6d3700 1 -- 172.21.15.160:0/916728883 shutdown_connections 2020-11-20T12:22:28.383 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.372+0000 7f94be6d3700 1 -- 172.21.15.160:0/916728883 wait complete. 2020-11-20T12:22:28.383 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.373+0000 7f94be6d3700 1 Processor -- start 2020-11-20T12:22:28.384 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.374+0000 7f94be6d3700 1 -- start start 2020-11-20T12:22:28.384 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94be6d3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94b8063ee0 0x7f94b80bf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.384 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94be6d3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b80bae80 0x7f94b80bda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.384 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94be6d3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b80bdef0 0x7f94b81492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.385 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94be6d3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8155e10 con 0x7f94b8063ee0 2020-11-20T12:22:28.385 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94be6d3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80bfe10 con 0x7f94b80bae80 2020-11-20T12:22:28.385 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94be6d3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b815ffe0 con 0x7f94b80bdef0 2020-11-20T12:22:28.385 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94bded2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b80bdef0 0x7f94b81492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.386 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94bced0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b80bae80 0x7f94b80bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.386 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94bd6d1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94b8063ee0 0x7f94b80bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.386 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94bced0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b80bae80 0x7f94b80bda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51792/0 (socket says 172.21.15.160:51792) 2020-11-20T12:22:28.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.375+0000 7f94bced0700 1 -- 172.21.15.160:0/3110962278 learned_addr learned my addr 172.21.15.160:0/3110962278 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:28.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94bded2700 1 -- 172.21.15.160:0/3110962278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b80bae80 msgr2=0x7f94b80bda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94bded2700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94b80bae80 0x7f94b80bda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.387 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94bded2700 1 -- 172.21.15.160:0/3110962278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94b8063ee0 msgr2=0x7f94b80bf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.388 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94bded2700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94b8063ee0 0x7f94b80bf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.388 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94bded2700 1 -- 172.21.15.160:0/3110962278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b8160280 con 0x7f94b80bdef0 2020-11-20T12:22:28.388 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94bd6d1700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94b8063ee0 0x7f94b80bf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:28.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94bded2700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b80bdef0 0x7f94b81492b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f94b000dfd0 tx=0x7f94b0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:28.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000f5e0 con 0x7f94b80bdef0 2020-11-20T12:22:28.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b000f740 con 0x7f94b80bdef0 2020-11-20T12:22:28.389 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000fac0 con 0x7f94b80bdef0 2020-11-20T12:22:28.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.376+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b8160520 con 0x7f94b80bdef0 2020-11-20T12:22:28.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.377+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b8160a60 con 0x7f94b80bdef0 2020-11-20T12:22:28.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.377+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94b8069460 con 0x7f94b80bdef0 2020-11-20T12:22:28.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.379+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f94b001a030 con 0x7f94b80bdef0 2020-11-20T12:22:28.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.380+0000 7f94a57fa700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9490080660 0x7f9490082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.380+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f94b00a22b0 con 0x7f94b80bdef0 2020-11-20T12:22:28.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.380+0000 7f94a57fa700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f9490088d00 0x7f949008b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.380+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 --> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f949008b780 con 0x7f9490088d00 2020-11-20T12:22:28.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.380+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94b00a4810 con 0x7f94b80bdef0 2020-11-20T12:22:28.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.380+0000 7f94bd6d1700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9490080660 0x7f9490082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.380+0000 7f94bced0700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f9490088d00 0x7f949008b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.381+0000 7f94bd6d1700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9490080660 0x7f9490082b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f94b80670b0 tx=0x7f94b4016000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:28.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.381+0000 7f94bced0700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f9490088d00 0x7f949008b120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:28.394 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.382+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== osd.3 v2:172.21.15.160:6800/17043 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f949008b780 con 0x7f9490088d00 2020-11-20T12:22:28.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.397+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 --> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f94b8160c60 con 0x7f9490088d00 2020-11-20T12:22:28.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.397+0000 7f94a57fa700 1 -- 172.21.15.160:0/3110962278 <== osd.3 v2:172.21.15.160:6800/17043 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f94a800cbb0 con 0x7f9490088d00 2020-11-20T12:22:28.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f9490088d00 msgr2=0x7f949008b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:6800/17043,v1:172.21.15.160:6801/17043] conn(0x7f9490088d00 0x7f949008b120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9490080660 msgr2=0x7f9490082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f9490080660 0x7f9490082b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f94b80670b0 tx=0x7f94b4016000).stop 2020-11-20T12:22:28.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b80bdef0 msgr2=0x7f94b81492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 --2- 172.21.15.160:0/3110962278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b80bdef0 0x7f94b81492b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f94b000dfd0 tx=0x7f94b0008040).stop 2020-11-20T12:22:28.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94bded2700 1 -- 172.21.15.160:0/3110962278 reap_dead start 2020-11-20T12:22:28.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 shutdown_connections 2020-11-20T12:22:28.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 >> 172.21.15.160:0/3110962278 conn(0x7f94b80c2f70 msgr2=0x7f94b80c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:28.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 shutdown_connections 2020-11-20T12:22:28.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.398+0000 7f94be6d3700 1 -- 172.21.15.160:0/3110962278 wait complete. 2020-11-20T12:22:28.404 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:28.404 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:28.404 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:28.423 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2020-11-20T12:22:28.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.639+0000 7f5afdbb1700 1 Processor -- start 2020-11-20T12:22:28.642 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.639+0000 7f5afdbb1700 1 -- start start 2020-11-20T12:22:28.643 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.640+0000 7f5afdbb1700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5af80c0940 0x7f5af80631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.640+0000 7f5afdbb1700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5af80636a0 0x7f5af814d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.640+0000 7f5afdbb1700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80c1120 con 0x7f5af809b630 2020-11-20T12:22:28.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.640+0000 7f5afdbb1700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80ba950 con 0x7f5af80636a0 2020-11-20T12:22:28.644 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.640+0000 7f5afdbb1700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af809a6e0 con 0x7f5af80c0940 2020-11-20T12:22:28.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5afd3b0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f5af80636a0 0x7f5af814d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5af7fff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5af80c0940 0x7f5af80631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5afcbaf700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f5af809b630 0x7f5af809ba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60972/0 (socket says 172.21.15.160:60972) 2020-11-20T12:22:28.645 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5afcbaf700 1 -- 172.21.15.160:0/2612935951 learned_addr learned my addr 172.21.15.160:0/2612935951 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:28.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5afd3b0700 1 -- 172.21.15.160:0/2612935951 >> v2:172.21.15.160:3300/0 conn(0x7f5af80c0940 msgr2=0x7f5af80631b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:28.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5afd3b0700 1 --2- 172.21.15.160:0/2612935951 >> v2:172.21.15.160:3300/0 conn(0x7f5af80c0940 0x7f5af80631b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5afd3b0700 1 -- 172.21.15.160:0/2612935951 >> v1:172.21.15.134:6789/0 conn(0x7f5af809b630 legacy=0x7f5af809ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5af77fe700 1 -- 172.21.15.160:0/2612935951 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273133710 0 0) 0x7f5af80c1120 con 0x7f5af809b630 2020-11-20T12:22:28.647 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.641+0000 7f5afd3b0700 1 -- 172.21.15.160:0/2612935951 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80c0e80 con 0x7f5af80636a0 2020-11-20T12:22:28.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5afd3b0700 1 --2- 172.21.15.160:0/2612935951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af814d890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5af0009c90 tx=0x7f5af00091d0).ready entity=mon.0 client_cookie=e0c5548af351083a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:28.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5af77fe700 1 -- 172.21.15.160:0/2612935951 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000ba30 con 0x7f5af80636a0 2020-11-20T12:22:28.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5af77fe700 1 -- 172.21.15.160:0/2612935951 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000bb90 con 0x7f5af80636a0 2020-11-20T12:22:28.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5af77fe700 1 -- 172.21.15.160:0/2612935951 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0010470 con 0x7f5af80636a0 2020-11-20T12:22:28.648 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5afdbb1700 1 -- 172.21.15.160:0/2612935951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 msgr2=0x7f5af814d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/2612935951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af814d890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f5af0009c90 tx=0x7f5af00091d0).stop 2020-11-20T12:22:28.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5afdbb1700 1 -- 172.21.15.160:0/2612935951 shutdown_connections 2020-11-20T12:22:28.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.642+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/2612935951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af814d890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.643+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/2612935951 >> v2:172.21.15.160:3300/0 conn(0x7f5af80c0940 0x7f5af80631b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.643+0000 7f5afdbb1700 1 -- 172.21.15.160:0/2612935951 >> 172.21.15.160:0/2612935951 conn(0x7f5af80c4210 msgr2=0x7f5af80c0230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:28.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.643+0000 7f5afdbb1700 1 -- 172.21.15.160:0/2612935951 shutdown_connections 2020-11-20T12:22:28.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.643+0000 7f5afdbb1700 1 -- 172.21.15.160:0/2612935951 wait complete. 2020-11-20T12:22:28.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.644+0000 7f5afdbb1700 1 Processor -- start 2020-11-20T12:22:28.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.645+0000 7f5afdbb1700 1 -- start start 2020-11-20T12:22:28.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afdbb1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af80bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afdbb1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af809b630 0x7f5af81555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afdbb1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5af80c0940 0x7f5af80c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afdbb1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81636b0 con 0x7f5af80636a0 2020-11-20T12:22:28.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afdbb1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80bbad0 con 0x7f5af80c0940 2020-11-20T12:22:28.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afdbb1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8164560 con 0x7f5af809b630 2020-11-20T12:22:28.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5af7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af809b630 0x7f5af81555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afcbaf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af80bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5af7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af809b630 0x7f5af81555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38672/0 (socket says 172.21.15.160:38672) 2020-11-20T12:22:28.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5af7fff700 1 -- 172.21.15.160:0/3953739231 learned_addr learned my addr 172.21.15.160:0/3953739231 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:28.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afcbaf700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af80bb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:32960/0 (socket says 172.21.15.160:32960) 2020-11-20T12:22:28.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.646+0000 7f5afd3b0700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5af80c0940 0x7f5af80c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af7fff700 1 -- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5af80c0940 msgr2=0x7f5af80c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.655 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af7fff700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5af80c0940 0x7f5af80c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af7fff700 1 -- 172.21.15.160:0/3953739231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 msgr2=0x7f5af80bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af7fff700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af80bb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af7fff700 1 -- 172.21.15.160:0/3953739231 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8155d70 con 0x7f5af809b630 2020-11-20T12:22:28.656 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5afd3b0700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5af80c0940 0x7f5af80c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:28.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af7fff700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af809b630 0x7f5af81555d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5ae400ebd0 tx=0x7f5ae4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:28.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af4ff9700 1 -- 172.21.15.160:0/3953739231 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400b810 con 0x7f5af809b630 2020-11-20T12:22:28.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af4ff9700 1 -- 172.21.15.160:0/3953739231 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae400b970 con 0x7f5af809b630 2020-11-20T12:22:28.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af81638e0 con 0x7f5af809b630 2020-11-20T12:22:28.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5af4ff9700 1 -- 172.21.15.160:0/3953739231 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400bcf0 con 0x7f5af809b630 2020-11-20T12:22:28.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.647+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af8163e20 con 0x7f5af809b630 2020-11-20T12:22:28.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.648+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af8062c30 con 0x7f5af809b630 2020-11-20T12:22:28.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.650+0000 7f5af4ff9700 1 -- 172.21.15.160:0/3953739231 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5ae4012600 con 0x7f5af809b630 2020-11-20T12:22:28.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.651+0000 7f5af4ff9700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5ad0080630 0x7f5ad0082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:28.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.651+0000 7f5af4ff9700 1 -- 172.21.15.160:0/3953739231 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f5ae40a2b00 con 0x7f5af809b630 2020-11-20T12:22:28.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.651+0000 7f5afcbaf700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5ad0080630 0x7f5ad0082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:28.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.652+0000 7f5afcbaf700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5ad0080630 0x7f5ad0082af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5aec0011a0 tx=0x7f5aec0079e0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:28.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.655+0000 7f5af4ff9700 1 -- 172.21.15.160:0/3953739231 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5ae4077700 con 0x7f5af809b630 2020-11-20T12:22:28.844 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.841+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5af8155ac0 con 0x7f5ad0080630 2020-11-20T12:22:28.845 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.842+0000 7f5af4ff9700 1 -- 172.21.15.160:0/3953739231 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5af8155ac0 con 0x7f5ad0080630 2020-11-20T12:22:28.847 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5ad0080630 msgr2=0x7f5ad0082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.847 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5ad0080630 0x7f5ad0082af0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5aec0011a0 tx=0x7f5aec0079e0).stop 2020-11-20T12:22:28.848 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af809b630 msgr2=0x7f5af81555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:28.848 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af809b630 0x7f5af81555d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f5ae400ebd0 tx=0x7f5ae4006df0).stop 2020-11-20T12:22:28.848 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 shutdown_connections 2020-11-20T12:22:28.848 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5ad0080630 0x7f5ad0082af0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.848 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5af80c0940 0x7f5af80c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5af80636a0 0x7f5af80bb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 --2- 172.21.15.160:0/3953739231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af809b630 0x7f5af81555d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:28.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 >> 172.21.15.160:0/3953739231 conn(0x7f5af80c4210 msgr2=0x7f5af8064fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:28.849 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 shutdown_connections 2020-11-20T12:22:28.850 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:28.844+0000 7f5afdbb1700 1 -- 172.21.15.160:0/3953739231 wait complete. 2020-11-20T12:22:28.850 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 3 to deep-scrub 2020-11-20T12:22:28.870 INFO:tasks.ceph:Scrubbing osd.6 2020-11-20T12:22:28.871 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:29.103 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.100+0000 7fa8d2045700 1 Processor -- start 2020-11-20T12:22:29.104 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.100+0000 7fa8d2045700 1 -- start start 2020-11-20T12:22:29.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d2045700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8cc0c3e30 0x7fa8cc0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d2045700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8cc0c4210 0x7fa8cc065780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d2045700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc064e10 con 0x7fa8cc0627c0 2020-11-20T12:22:29.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d2045700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0c4660 con 0x7fa8cc0c3e30 2020-11-20T12:22:29.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d2045700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc151540 con 0x7fa8cc0c4210 2020-11-20T12:22:29.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d1043700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fa8cc0c3e30 0x7fa8cc0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d1844700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fa8cc0c4210 0x7fa8cc065780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d0842700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fa8cc0627c0 0x7fa8cc150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:60988/0 (socket says 172.21.15.160:60988) 2020-11-20T12:22:29.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.102+0000 7fa8d0842700 1 -- 172.21.15.160:0/3427676638 learned_addr learned my addr 172.21.15.160:0/3427676638 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:29.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8d1043700 1 -- 172.21.15.160:0/3427676638 >> v2:172.21.15.150:3300/0 conn(0x7fa8cc0c4210 msgr2=0x7fa8cc065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:29.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8d1043700 1 --2- 172.21.15.160:0/3427676638 >> v2:172.21.15.150:3300/0 conn(0x7fa8cc0c4210 0x7fa8cc065780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8bbfff700 1 -- 172.21.15.160:0/3427676638 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996399004 0 0) 0x7fa8cc064e10 con 0x7fa8cc0627c0 2020-11-20T12:22:29.109 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8d1043700 1 -- 172.21.15.160:0/3427676638 >> v1:172.21.15.134:6789/0 conn(0x7fa8cc0627c0 legacy=0x7fa8cc150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.110 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8d1043700 1 -- 172.21.15.160:0/3427676638 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc1517e0 con 0x7fa8cc0c3e30 2020-11-20T12:22:29.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8d1844700 1 --2- 172.21.15.160:0/3427676638 >> v2:172.21.15.150:3300/0 conn(0x7fa8cc0c4210 0x7fa8cc065780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:29.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8d1043700 1 --2- 172.21.15.160:0/3427676638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0c3e30 0x7fa8cc0c1d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa8cc068930 tx=0x7fa8c8006df0).ready entity=mon.0 client_cookie=dc9f46a34733888e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.115 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8bbfff700 1 -- 172.21.15.160:0/3427676638 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80097b0 con 0x7fa8cc0c3e30 2020-11-20T12:22:29.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8bbfff700 1 -- 172.21.15.160:0/3427676638 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8009910 con 0x7fa8cc0c3e30 2020-11-20T12:22:29.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.103+0000 7fa8bbfff700 1 -- 172.21.15.160:0/3427676638 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8009c90 con 0x7fa8cc0c3e30 2020-11-20T12:22:29.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 -- 172.21.15.160:0/3427676638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0c3e30 msgr2=0x7fa8cc0c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.116 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 --2- 172.21.15.160:0/3427676638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0c3e30 0x7fa8cc0c1d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa8cc068930 tx=0x7fa8c8006df0).stop 2020-11-20T12:22:29.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 -- 172.21.15.160:0/3427676638 shutdown_connections 2020-11-20T12:22:29.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 --2- 172.21.15.160:0/3427676638 >> v2:172.21.15.150:3300/0 conn(0x7fa8cc0c4210 0x7fa8cc065780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.117 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 --2- 172.21.15.160:0/3427676638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0c3e30 0x7fa8cc0c1d30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 -- 172.21.15.160:0/3427676638 >> 172.21.15.160:0/3427676638 conn(0x7fa8cc062ed0 msgr2=0x7fa8cc0632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:29.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 -- 172.21.15.160:0/3427676638 shutdown_connections 2020-11-20T12:22:29.118 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.104+0000 7fa8d2045700 1 -- 172.21.15.160:0/3427676638 wait complete. 2020-11-20T12:22:29.119 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.106+0000 7fa8d2045700 1 Processor -- start 2020-11-20T12:22:29.119 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.106+0000 7fa8d2045700 1 -- start start 2020-11-20T12:22:29.119 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d2045700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0627c0 0x7fa8cc14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.119 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d2045700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8cc0c3e30 0x7fa8cc152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d2045700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8cc0c4210 0x7fa8cc14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.120 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d2045700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc160de0 con 0x7fa8cc0627c0 2020-11-20T12:22:29.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d2045700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc15ff30 con 0x7fa8cc0c3e30 2020-11-20T12:22:29.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d2045700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc14f810 con 0x7fa8cc0c4210 2020-11-20T12:22:29.121 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0627c0 0x7fa8cc14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0627c0 0x7fa8cc14d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:32974/0 (socket says 172.21.15.160:32974) 2020-11-20T12:22:29.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 -- 172.21.15.160:0/792667161 learned_addr learned my addr 172.21.15.160:0/792667161 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:29.122 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1844700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8cc0c4210 0x7fa8cc14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d0842700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8cc0c3e30 0x7fa8cc152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 -- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8cc0c4210 msgr2=0x7fa8cc14f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8cc0c4210 0x7fa8cc14f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.123 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 -- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8cc0c3e30 msgr2=0x7fa8cc152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa8cc0c3e30 0x7fa8cc152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.108+0000 7fa8d1043700 1 -- 172.21.15.160:0/792667161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc160160 con 0x7fa8cc0627c0 2020-11-20T12:22:29.124 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.109+0000 7fa8d1043700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0627c0 0x7fa8cc14d940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa8cc066c40 tx=0x7fa8c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.125 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.109+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8011dc0 con 0x7fa8cc0627c0 2020-11-20T12:22:29.125 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.109+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c801e460 con 0x7fa8cc0627c0 2020-11-20T12:22:29.125 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.109+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc160400 con 0x7fa8cc0627c0 2020-11-20T12:22:29.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.109+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c801e800 con 0x7fa8cc0627c0 2020-11-20T12:22:29.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.109+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc160940 con 0x7fa8cc0627c0 2020-11-20T12:22:29.126 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.110+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8cc0bfbb0 con 0x7fa8cc0627c0 2020-11-20T12:22:29.127 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.112+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa8c8025030 con 0x7fa8cc0627c0 2020-11-20T12:22:29.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.112+0000 7fa8b97fa700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa8a4080630 0x7fa8a4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.128 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.113+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fa8c80a4600 con 0x7fa8cc0627c0 2020-11-20T12:22:29.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.113+0000 7fa8b97fa700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7fa8a4088cd0 0x7fa8a408b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.113+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 --> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8a408b750 con 0x7fa8a4088cd0 2020-11-20T12:22:29.129 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.113+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8c80a4a00 con 0x7fa8cc0627c0 2020-11-20T12:22:29.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.113+0000 7fa8d0842700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa8a4080630 0x7fa8a4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.113+0000 7fa8d1844700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7fa8a4088cd0 0x7fa8a408b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.130 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.114+0000 7fa8d0842700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa8a4080630 0x7fa8a4082af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fa8cc160f80 tx=0x7fa8bc0079e0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.131 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.114+0000 7fa8d1844700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7fa8a4088cd0 0x7fa8a408b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.131 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.115+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== osd.6 v2:172.21.15.160:6816/17072 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fa8a408b750 con 0x7fa8a4088cd0 2020-11-20T12:22:29.133 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.130+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 --> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa8cc14f560 con 0x7fa8a4088cd0 2020-11-20T12:22:29.134 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8b97fa700 1 -- 172.21.15.160:0/792667161 <== osd.6 v2:172.21.15.160:6816/17072 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa8cc14f560 con 0x7fa8a4088cd0 2020-11-20T12:22:29.134 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7fa8a4088cd0 msgr2=0x7fa8a408b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.135 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.160:6816/17072,v1:172.21.15.160:6819/17072] conn(0x7fa8a4088cd0 0x7fa8a408b0f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.135 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa8a4080630 msgr2=0x7fa8a4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.135 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fa8a4080630 0x7fa8a4082af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fa8cc160f80 tx=0x7fa8bc0079e0).stop 2020-11-20T12:22:29.135 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0627c0 msgr2=0x7fa8cc14d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.135 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 --2- 172.21.15.160:0/792667161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8cc0627c0 0x7fa8cc14d940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa8cc066c40 tx=0x7fa8c8015000).stop 2020-11-20T12:22:29.136 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d1844700 1 -- 172.21.15.160:0/792667161 reap_dead start 2020-11-20T12:22:29.136 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:29.136 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:29.136 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:29.137 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 shutdown_connections 2020-11-20T12:22:29.137 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.131+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 >> 172.21.15.160:0/792667161 conn(0x7fa8cc062ed0 msgr2=0x7fa8cc0c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:29.137 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.132+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 shutdown_connections 2020-11-20T12:22:29.138 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.132+0000 7fa8d2045700 1 -- 172.21.15.160:0/792667161 wait complete. 2020-11-20T12:22:29.156 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2020-11-20T12:22:29.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.400+0000 7f0145b9b700 1 Processor -- start 2020-11-20T12:22:29.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.401+0000 7f0145b9b700 1 -- start start 2020-11-20T12:22:29.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.402+0000 7f0145b9b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0140061870 0x7f0140061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.402+0000 7f0145b9b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0140064960 0x7f0140064df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.402+0000 7f0145b9b700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01400bbe80 con 0x7f0140151070 2020-11-20T12:22:29.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.402+0000 7f0145b9b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400bd380 con 0x7f0140061870 2020-11-20T12:22:29.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.402+0000 7f0145b9b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400652e0 con 0x7f0140064960 2020-11-20T12:22:29.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f014539a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0140064960 0x7f0140064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f0144b99700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f0140061870 0x7f0140061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f014539a700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0140064960 0x7f0140064df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38698/0 (socket says 172.21.15.160:38698) 2020-11-20T12:22:29.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f014539a700 1 -- 172.21.15.160:0/1142036232 learned_addr learned my addr 172.21.15.160:0/1142036232 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:29.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f0137fff700 1 --1- 172.21.15.160:0/1142036232 >> v1:172.21.15.134:6789/0 conn(0x7f0140151070 0x7f01400bb770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:32772/0 (socket says 172.21.15.160:32772) 2020-11-20T12:22:29.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f0144b99700 1 -- 172.21.15.160:0/1142036232 >> v2:172.21.15.160:3300/0 conn(0x7f0140064960 msgr2=0x7f0140064df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:29.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f0144b99700 1 --2- 172.21.15.160:0/1142036232 >> v2:172.21.15.160:3300/0 conn(0x7f0140064960 0x7f0140064df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.411 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f01377fe700 1 -- 172.21.15.160:0/1142036232 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224044352 0 0) 0x7f01400bbe80 con 0x7f0140151070 2020-11-20T12:22:29.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f0144b99700 1 -- 172.21.15.160:0/1142036232 >> v1:172.21.15.134:6789/0 conn(0x7f0140151070 legacy=0x7f01400bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.403+0000 7f0144b99700 1 -- 172.21.15.160:0/1142036232 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400bc0d0 con 0x7f0140061870 2020-11-20T12:22:29.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.404+0000 7f0144b99700 1 --2- 172.21.15.160:0/1142036232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140061870 0x7f0140061c50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f01400bb460 tx=0x7f013c006e80).ready entity=mon.1 client_cookie=70c90c3d7b62be36 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.412 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.404+0000 7f01377fe700 1 -- 172.21.15.160:0/1142036232 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c012070 con 0x7f0140061870 2020-11-20T12:22:29.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.404+0000 7f01377fe700 1 -- 172.21.15.160:0/1142036232 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00d2e0 con 0x7f0140061870 2020-11-20T12:22:29.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.404+0000 7f01377fe700 1 -- 172.21.15.160:0/1142036232 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00fbc0 con 0x7f0140061870 2020-11-20T12:22:29.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.404+0000 7f0145b9b700 1 -- 172.21.15.160:0/1142036232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140061870 msgr2=0x7f0140061c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.404+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1142036232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140061870 0x7f0140061c50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f01400bb460 tx=0x7f013c006e80).stop 2020-11-20T12:22:29.413 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.405+0000 7f0145b9b700 1 -- 172.21.15.160:0/1142036232 shutdown_connections 2020-11-20T12:22:29.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.405+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1142036232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140061870 0x7f0140061c50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.405+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1142036232 >> v2:172.21.15.160:3300/0 conn(0x7f0140064960 0x7f0140064df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.414 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.405+0000 7f0145b9b700 1 -- 172.21.15.160:0/1142036232 >> 172.21.15.160:0/1142036232 conn(0x7f0140062ef0 msgr2=0x7f0140063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:29.416 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.405+0000 7f0145b9b700 1 -- 172.21.15.160:0/1142036232 shutdown_connections 2020-11-20T12:22:29.417 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.405+0000 7f0145b9b700 1 -- 172.21.15.160:0/1142036232 wait complete. 2020-11-20T12:22:29.417 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.406+0000 7f0145b9b700 1 Processor -- start 2020-11-20T12:22:29.417 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.406+0000 7f0145b9b700 1 -- start start 2020-11-20T12:22:29.417 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.407+0000 7f0145b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0140061870 0x7f014015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.418 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.407+0000 7f0145b9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0140064960 0x7f0140111de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.418 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.407+0000 7f0145b9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140151070 0x7f01400bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.418 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.407+0000 7f0145b9b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014015cd50 con 0x7f0140064960 2020-11-20T12:22:29.418 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.407+0000 7f0145b9b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014015f4b0 con 0x7f0140151070 2020-11-20T12:22:29.418 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.407+0000 7f0145b9b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014015f750 con 0x7f0140061870 2020-11-20T12:22:29.419 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0140061870 0x7f014015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.419 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0140061870 0x7f014015c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38700/0 (socket says 172.21.15.160:38700) 2020-11-20T12:22:29.419 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 -- 172.21.15.160:0/1132907309 learned_addr learned my addr 172.21.15.160:0/1132907309 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:29.419 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0137fff700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0140064960 0x7f0140111de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.419 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f014539a700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140151070 0x7f01400bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.420 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 -- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140151070 msgr2=0x7f01400bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.420 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140151070 0x7f01400bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.420 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 -- 172.21.15.160:0/1132907309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0140064960 msgr2=0x7f0140111de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.420 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0140064960 0x7f0140111de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.420 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 -- 172.21.15.160:0/1132907309 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014015f9f0 con 0x7f0140061870 2020-11-20T12:22:29.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.408+0000 7f0144b99700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0140061870 0x7f014015c860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f013c010010 tx=0x7f01400646e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.409+0000 7f0134ff9700 1 -- 172.21.15.160:0/1132907309 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00b450 con 0x7f0140061870 2020-11-20T12:22:29.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.409+0000 7f0134ff9700 1 -- 172.21.15.160:0/1132907309 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c00b5b0 con 0x7f0140061870 2020-11-20T12:22:29.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.409+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014015fc90 con 0x7f0140061870 2020-11-20T12:22:29.421 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.409+0000 7f0134ff9700 1 -- 172.21.15.160:0/1132907309 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c00b970 con 0x7f0140061870 2020-11-20T12:22:29.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.409+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014010eff0 con 0x7f0140061870 2020-11-20T12:22:29.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.410+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0140151590 con 0x7f0140061870 2020-11-20T12:22:29.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.411+0000 7f0134ff9700 1 -- 172.21.15.160:0/1132907309 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f013c00bd20 con 0x7f0140061870 2020-11-20T12:22:29.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.412+0000 7f0134ff9700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0118080630 0x7f0118082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.422 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.412+0000 7f0134ff9700 1 -- 172.21.15.160:0/1132907309 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f013c0a77f0 con 0x7f0140061870 2020-11-20T12:22:29.423 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.412+0000 7f0137fff700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0118080630 0x7f0118082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.423 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.413+0000 7f0137fff700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0118080630 0x7f0118082af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f01400634b0 tx=0x7f0130007bc0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.423 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.415+0000 7f0134ff9700 1 -- 172.21.15.160:0/1132907309 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f013c07c3f0 con 0x7f0140061870 2020-11-20T12:22:29.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.602+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f0140044f60 con 0x7f0118080630 2020-11-20T12:22:29.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.603+0000 7f0134ff9700 1 -- 172.21.15.160:0/1132907309 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0140044f60 con 0x7f0118080630 2020-11-20T12:22:29.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0118080630 msgr2=0x7f0118082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0118080630 0x7f0118082af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f01400634b0 tx=0x7f0130007bc0).stop 2020-11-20T12:22:29.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0140061870 msgr2=0x7f014015c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0140061870 0x7f014015c860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f013c010010 tx=0x7f01400646e0).stop 2020-11-20T12:22:29.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 shutdown_connections 2020-11-20T12:22:29.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0118080630 0x7f0118082af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.609 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0140151070 0x7f01400bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0140061870 0x7f014015c860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 --2- 172.21.15.160:0/1132907309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0140064960 0x7f0140111de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 >> 172.21.15.160:0/1132907309 conn(0x7f0140062ef0 msgr2=0x7f014014ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:29.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 shutdown_connections 2020-11-20T12:22:29.610 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.605+0000 7f0145b9b700 1 -- 172.21.15.160:0/1132907309 wait complete. 2020-11-20T12:22:29.611 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 6 to deep-scrub 2020-11-20T12:22:29.631 INFO:tasks.ceph:Scrubbing osd.9 2020-11-20T12:22:29.632 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:29.869 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.866+0000 7f659484b700 1 Processor -- start 2020-11-20T12:22:29.869 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.866+0000 7f659484b700 1 -- start start 2020-11-20T12:22:29.871 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.867+0000 7f659484b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f65900627c0 0x7f65900c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.871 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f659484b700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6590064e10 con 0x7f65900c1d30 2020-11-20T12:22:29.871 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f659484b700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6590065e90 con 0x7f65900c3e30 2020-11-20T12:22:29.871 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f659484b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6590062c10 con 0x7f65900627c0 2020-11-20T12:22:29.872 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f658effd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f65900c1d30 0x7f6590065780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47554/0 (socket says 172.21.15.160:47554) 2020-11-20T12:22:29.872 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f658ffff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f65900627c0 0x7f65900c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.872 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f658effd700 1 -- 172.21.15.160:0/2017664987 learned_addr learned my addr 172.21.15.160:0/2017664987 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:29.872 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f658f7fe700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f65900c3e30 0x7f6590150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56288/0 (socket says 172.21.15.160:56288) 2020-11-20T12:22:29.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f658e7fc700 1 -- 172.21.15.160:0/2017664987 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224329798 0 0) 0x7f6590064e10 con 0x7f65900c1d30 2020-11-20T12:22:29.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f658e7fc700 1 -- 172.21.15.160:0/2017664987 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f657c003240 con 0x7f65900c1d30 2020-11-20T12:22:29.874 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.868+0000 7f658e7fc700 1 -- 172.21.15.160:0/2017664987 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685884221 0 0) 0x7f6590065e90 con 0x7f65900c3e30 2020-11-20T12:22:29.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658e7fc700 1 -- 172.21.15.160:0/2017664987 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6590064e10 con 0x7f65900c3e30 2020-11-20T12:22:29.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658ffff700 1 -- 172.21.15.160:0/2017664987 >> v1:172.21.15.160:6789/0 conn(0x7f65900c3e30 legacy=0x7f6590150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658ffff700 1 -- 172.21.15.160:0/2017664987 >> v1:172.21.15.150:6789/0 conn(0x7f65900c1d30 legacy=0x7f6590065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658ffff700 1 -- 172.21.15.160:0/2017664987 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590151540 con 0x7f65900627c0 2020-11-20T12:22:29.875 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658ffff700 1 --2- 172.21.15.160:0/2017664987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900627c0 0x7f65900c4210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6588009c90 tx=0x7f65880091d0).ready entity=mon.2 client_cookie=d6a88445c8697ae9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658e7fc700 1 -- 172.21.15.160:0/2017664987 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800b980 con 0x7f65900627c0 2020-11-20T12:22:29.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658e7fc700 1 -- 172.21.15.160:0/2017664987 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658800bae0 con 0x7f65900627c0 2020-11-20T12:22:29.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.869+0000 7f658e7fc700 1 -- 172.21.15.160:0/2017664987 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658800be60 con 0x7f65900627c0 2020-11-20T12:22:29.876 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.870+0000 7f659484b700 1 -- 172.21.15.160:0/2017664987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900627c0 msgr2=0x7f65900c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.870+0000 7f659484b700 1 --2- 172.21.15.160:0/2017664987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900627c0 0x7f65900c4210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f6588009c90 tx=0x7f65880091d0).stop 2020-11-20T12:22:29.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.870+0000 7f659484b700 1 -- 172.21.15.160:0/2017664987 shutdown_connections 2020-11-20T12:22:29.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.870+0000 7f659484b700 1 --2- 172.21.15.160:0/2017664987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900627c0 0x7f65900c4210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.870+0000 7f659484b700 1 -- 172.21.15.160:0/2017664987 >> 172.21.15.160:0/2017664987 conn(0x7f6590062ed0 msgr2=0x7f65900632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:29.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.870+0000 7f659484b700 1 -- 172.21.15.160:0/2017664987 shutdown_connections 2020-11-20T12:22:29.878 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.870+0000 7f659484b700 1 -- 172.21.15.160:0/2017664987 wait complete. 2020-11-20T12:22:29.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.872+0000 7f659484b700 1 Processor -- start 2020-11-20T12:22:29.880 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.872+0000 7f659484b700 1 -- start start 2020-11-20T12:22:29.880 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f659484b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65900627c0 0x7f65901605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.880 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f659484b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65900c1d30 0x7f6590111b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.880 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f659484b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900c3e30 0x7f65901137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.881 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f659484b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590160ae0 con 0x7f65900c1d30 2020-11-20T12:22:29.881 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f659484b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590163250 con 0x7f65900627c0 2020-11-20T12:22:29.881 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f659484b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65901634f0 con 0x7f65900c3e30 2020-11-20T12:22:29.881 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f658ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900c3e30 0x7f65901137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.881 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f658f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65900627c0 0x7f65901605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.882 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f658f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65900627c0 0x7f65901605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51850/0 (socket says 172.21.15.160:51850) 2020-11-20T12:22:29.882 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f658ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900c3e30 0x7f65901137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38718/0 (socket says 172.21.15.160:38718) 2020-11-20T12:22:29.882 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f658f7fe700 1 -- 172.21.15.160:0/680659046 learned_addr learned my addr 172.21.15.160:0/680659046 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:29.882 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.873+0000 7f658effd700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65900c1d30 0x7f6590111b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.882 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f658f7fe700 1 -- 172.21.15.160:0/680659046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900c3e30 msgr2=0x7f65901137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f658f7fe700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65900c3e30 0x7f65901137f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f658f7fe700 1 -- 172.21.15.160:0/680659046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65900c1d30 msgr2=0x7f6590111b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f658f7fe700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65900c1d30 0x7f6590111b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f658f7fe700 1 -- 172.21.15.160:0/680659046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590163790 con 0x7f65900627c0 2020-11-20T12:22:29.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f658f7fe700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65900627c0 0x7f65901605f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f658000c6e0 tx=0x7f6580007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.884 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800072e0 con 0x7f65900627c0 2020-11-20T12:22:29.884 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580005530 con 0x7f65900627c0 2020-11-20T12:22:29.884 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6590163a30 con 0x7f65900627c0 2020-11-20T12:22:29.884 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.874+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800058f0 con 0x7f65900627c0 2020-11-20T12:22:29.885 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.875+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6590163f70 con 0x7f65900627c0 2020-11-20T12:22:29.885 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.875+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65901500c0 con 0x7f65900627c0 2020-11-20T12:22:29.885 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.877+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f658001a060 con 0x7f65900627c0 2020-11-20T12:22:29.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.878+0000 7f656f7fe700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6568080630 0x7f6568082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.878+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f65800a28d0 con 0x7f65900627c0 2020-11-20T12:22:29.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.878+0000 7f658effd700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6568080630 0x7f6568082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.878+0000 7f656f7fe700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7f6568088cd0 0x7f656808b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:29.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.878+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 --> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f656808b750 con 0x7f6568088cd0 2020-11-20T12:22:29.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.878+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65800a2c00 con 0x7f65900627c0 2020-11-20T12:22:29.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.878+0000 7f658ffff700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7f6568088cd0 0x7f656808b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:29.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.879+0000 7f658effd700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6568080630 0x7f6568082af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f65900c7b40 tx=0x7f6584009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.879+0000 7f658ffff700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7f6568088cd0 0x7f656808b0f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:29.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.880+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== osd.9 v2:172.21.15.160:6817/17065 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f656808b750 con 0x7f6568088cd0 2020-11-20T12:22:29.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.895+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 --> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6590069460 con 0x7f6568088cd0 2020-11-20T12:22:29.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.895+0000 7f656f7fe700 1 -- 172.21.15.160:0/680659046 <== osd.9 v2:172.21.15.160:6817/17065 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6590069460 con 0x7f6568088cd0 2020-11-20T12:22:29.899 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:29.899 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:29.899 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:29.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7f6568088cd0 msgr2=0x7f656808b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.160:6817/17065,v1:172.21.15.160:6818/17065] conn(0x7f6568088cd0 0x7f656808b0f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:29.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6568080630 msgr2=0x7f6568082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6568080630 0x7f6568082af0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f65900c7b40 tx=0x7f6584009040).stop 2020-11-20T12:22:29.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65900627c0 msgr2=0x7f65901605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:29.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 --2- 172.21.15.160:0/680659046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65900627c0 0x7f65901605f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f658000c6e0 tx=0x7f6580007c30).stop 2020-11-20T12:22:29.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f658ffff700 1 -- 172.21.15.160:0/680659046 reap_dead start 2020-11-20T12:22:29.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 shutdown_connections 2020-11-20T12:22:29.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 >> 172.21.15.160:0/680659046 conn(0x7f6590062ed0 msgr2=0x7f659014a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:29.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 shutdown_connections 2020-11-20T12:22:29.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:29.896+0000 7f659484b700 1 -- 172.21.15.160:0/680659046 wait complete. 2020-11-20T12:22:29.921 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2020-11-20T12:22:30.158 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.155+0000 7f26454ba700 1 Processor -- start 2020-11-20T12:22:30.159 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.155+0000 7f26454ba700 1 -- start start 2020-11-20T12:22:30.160 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.157+0000 7f26454ba700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f26400ba510 0x7f26400ba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.157+0000 7f26454ba700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f26400bc740 0x7f264014f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.161 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.157+0000 7f26454ba700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264014da40 con 0x7f2640151a90 2020-11-20T12:22:30.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.157+0000 7f26454ba700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26400bcbb0 con 0x7f26400ba510 2020-11-20T12:22:30.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.157+0000 7f26454ba700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264014dce0 con 0x7f26400bc740 2020-11-20T12:22:30.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.157+0000 7f2644cb9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f26400bc740 0x7f264014f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f2644cb9700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f26400bc740 0x7f264014f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38728/0 (socket says 172.21.15.160:38728) 2020-11-20T12:22:30.162 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f2644cb9700 1 -- 172.21.15.160:0/412353126 learned_addr learned my addr 172.21.15.160:0/412353126 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:30.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f263f7fe700 1 --1- 172.21.15.160:0/412353126 >> v1:172.21.15.150:6789/0 conn(0x7f2640151a90 0x7f26400bc030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47568/0 (socket says 172.21.15.160:47568) 2020-11-20T12:22:30.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f263ffff700 1 --2- 172.21.15.160:0/412353126 >> v2:172.21.15.134:3300/0 conn(0x7f26400ba510 0x7f26400ba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f2644cb9700 1 -- 172.21.15.160:0/412353126 >> v2:172.21.15.134:3300/0 conn(0x7f26400ba510 msgr2=0x7f26400ba8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:30.163 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f2644cb9700 1 --2- 172.21.15.160:0/412353126 >> v2:172.21.15.134:3300/0 conn(0x7f26400ba510 0x7f26400ba8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f2644cb9700 1 -- 172.21.15.160:0/412353126 >> v1:172.21.15.150:6789/0 conn(0x7f2640151a90 legacy=0x7f26400bc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f2644cb9700 1 -- 172.21.15.160:0/412353126 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264014df80 con 0x7f26400bc740 2020-11-20T12:22:30.164 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.158+0000 7f2644cb9700 1 --2- 172.21.15.160:0/412353126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 0x7f264014f000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2640151ef0 tx=0x7f2638009290).ready entity=mon.2 client_cookie=bd471a2f98f6f138 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f263effd700 1 -- 172.21.15.160:0/412353126 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263800bc50 con 0x7f26400bc740 2020-11-20T12:22:30.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f263effd700 1 -- 172.21.15.160:0/412353126 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263800bdb0 con 0x7f26400bc740 2020-11-20T12:22:30.165 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f263effd700 1 -- 172.21.15.160:0/412353126 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638011610 con 0x7f26400bc740 2020-11-20T12:22:30.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 -- 172.21.15.160:0/412353126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 msgr2=0x7f264014f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 --2- 172.21.15.160:0/412353126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 0x7f264014f000 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2640151ef0 tx=0x7f2638009290).stop 2020-11-20T12:22:30.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 -- 172.21.15.160:0/412353126 shutdown_connections 2020-11-20T12:22:30.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 --2- 172.21.15.160:0/412353126 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 0x7f264014f000 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 --2- 172.21.15.160:0/412353126 >> v2:172.21.15.134:3300/0 conn(0x7f26400ba510 0x7f26400ba8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 -- 172.21.15.160:0/412353126 >> 172.21.15.160:0/412353126 conn(0x7f2640062ef0 msgr2=0x7f2640063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:30.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 -- 172.21.15.160:0/412353126 shutdown_connections 2020-11-20T12:22:30.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.159+0000 7f26454ba700 1 -- 172.21.15.160:0/412353126 wait complete. 2020-11-20T12:22:30.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.161+0000 7f26454ba700 1 Processor -- start 2020-11-20T12:22:30.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.161+0000 7f26454ba700 1 -- start start 2020-11-20T12:22:30.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.162+0000 7f26454ba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400ba510 0x7f2640147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.162+0000 7f26454ba700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 0x7f26400c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.162+0000 7f26454ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2640151a90 0x7f26400c0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.162+0000 7f26454ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640147940 con 0x7f2640151a90 2020-11-20T12:22:30.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.162+0000 7f26454ba700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400c1f90 con 0x7f26400ba510 2020-11-20T12:22:30.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.162+0000 7f26454ba700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26400c1cf0 con 0x7f26400bc740 2020-11-20T12:22:30.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f2644cb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2640151a90 0x7f26400c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f263ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400ba510 0x7f2640147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f2644cb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2640151a90 0x7f26400c0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33024/0 (socket says 172.21.15.160:33024) 2020-11-20T12:22:30.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f2644cb9700 1 -- 172.21.15.160:0/1731923973 learned_addr learned my addr 172.21.15.160:0/1731923973 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:30.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f263f7fe700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 0x7f26400c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f263ffff700 1 -- 172.21.15.160:0/1731923973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 msgr2=0x7f26400c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f263ffff700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 0x7f26400c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f263ffff700 1 -- 172.21.15.160:0/1731923973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2640151a90 msgr2=0x7f26400c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f263ffff700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2640151a90 0x7f26400c0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f263ffff700 1 -- 172.21.15.160:0/1731923973 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26401611d0 con 0x7f26400ba510 2020-11-20T12:22:30.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.163+0000 7f2644cb9700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2640151a90 0x7f26400c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:30.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.164+0000 7f263ffff700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400ba510 0x7f2640147450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f263000ebd0 tx=0x7f2630006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.164+0000 7f261ffff700 1 -- 172.21.15.160:0/1731923973 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000c820 con 0x7f26400ba510 2020-11-20T12:22:30.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.164+0000 7f261ffff700 1 -- 172.21.15.160:0/1731923973 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263000c980 con 0x7f26400ba510 2020-11-20T12:22:30.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.164+0000 7f261ffff700 1 -- 172.21.15.160:0/1731923973 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000cd00 con 0x7f26400ba510 2020-11-20T12:22:30.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.164+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2640161470 con 0x7f26400ba510 2020-11-20T12:22:30.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.164+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26401619b0 con 0x7f26400ba510 2020-11-20T12:22:30.179 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.165+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2640161b70 con 0x7f26400ba510 2020-11-20T12:22:30.180 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.167+0000 7f261ffff700 1 -- 172.21.15.160:0/1731923973 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2630012600 con 0x7f26400ba510 2020-11-20T12:22:30.180 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.168+0000 7f261ffff700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2618080630 0x7f2618082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.180 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.169+0000 7f261ffff700 1 -- 172.21.15.160:0/1731923973 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f26300a2e90 con 0x7f26400ba510 2020-11-20T12:22:30.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.169+0000 7f263f7fe700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2618080630 0x7f2618082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.169+0000 7f263f7fe700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2618080630 0x7f2618082af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f264014bb70 tx=0x7f2634000b80).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.181 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.170+0000 7f261ffff700 1 -- 172.21.15.160:0/1731923973 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2630077a90 con 0x7f26400ba510 2020-11-20T12:22:30.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.355+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) v1 -- 0x7f2640044f60 con 0x7f2618080630 2020-11-20T12:22:30.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.356+0000 7f261ffff700 1 -- 172.21.15.160:0/1731923973 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2640044f60 con 0x7f2618080630 2020-11-20T12:22:30.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2618080630 msgr2=0x7f2618082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2618080630 0x7f2618082af0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f264014bb70 tx=0x7f2634000b80).stop 2020-11-20T12:22:30.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400ba510 msgr2=0x7f2640147450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400ba510 0x7f2640147450 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f263000ebd0 tx=0x7f2630006df0).stop 2020-11-20T12:22:30.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 shutdown_connections 2020-11-20T12:22:30.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2618080630 0x7f2618082af0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2640151a90 0x7f26400c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26400ba510 0x7f2640147450 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 --2- 172.21.15.160:0/1731923973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26400bc740 0x7f26400c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.359+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 >> 172.21.15.160:0/1731923973 conn(0x7f2640062ef0 msgr2=0x7f264014b170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:30.365 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.360+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 shutdown_connections 2020-11-20T12:22:30.365 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.360+0000 7f26454ba700 1 -- 172.21.15.160:0/1731923973 wait complete. 2020-11-20T12:22:30.365 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 9 to deep-scrub 2020-11-20T12:22:30.383 INFO:tasks.ceph:Scrubbing osd.1 2020-11-20T12:22:30.384 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:30.618 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.615+0000 7f8496f7d700 1 Processor -- start 2020-11-20T12:22:30.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.615+0000 7f8496f7d700 1 -- start start 2020-11-20T12:22:30.619 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.616+0000 7f8496f7d700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8490150ee0 0x7f84900c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f8496f7d700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f849014dd50 0x7f849014e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.620 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f8496f7d700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84901513f0 con 0x7f84900c1e20 2020-11-20T12:22:30.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f8496f7d700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8490151690 con 0x7f849014dd50 2020-11-20T12:22:30.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f8496f7d700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8490151930 con 0x7f8490150ee0 2020-11-20T12:22:30.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f848ffff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8490150ee0 0x7f84900c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f849551a700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f849014dd50 0x7f849014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.621 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f848ffff700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f8490150ee0 0x7f84900c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38740/0 (socket says 172.21.15.160:38740) 2020-11-20T12:22:30.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.617+0000 7f848ffff700 1 -- 172.21.15.160:0/1225345689 learned_addr learned my addr 172.21.15.160:0/1225345689 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:30.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f848f7fe700 1 -- 172.21.15.160:0/1225345689 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679696616 0 0) 0x7f84901513f0 con 0x7f84900c1e20 2020-11-20T12:22:30.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f848f7fe700 1 -- 172.21.15.160:0/1225345689 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8474003240 con 0x7f84900c1e20 2020-11-20T12:22:30.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f849551a700 1 -- 172.21.15.160:0/1225345689 >> v2:172.21.15.160:3300/0 conn(0x7f8490150ee0 msgr2=0x7f84900c2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:30.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f849551a700 1 --2- 172.21.15.160:0/1225345689 >> v2:172.21.15.160:3300/0 conn(0x7f8490150ee0 0x7f84900c2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f849551a700 1 -- 172.21.15.160:0/1225345689 >> v1:172.21.15.160:6789/0 conn(0x7f84900c1e20 legacy=0x7f84900632f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f849551a700 1 -- 172.21.15.160:0/1225345689 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490151bd0 con 0x7f849014dd50 2020-11-20T12:22:30.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f848ffff700 1 --2- 172.21.15.160:0/1225345689 >> v2:172.21.15.160:3300/0 conn(0x7f8490150ee0 0x7f84900c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:30.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.618+0000 7f849551a700 1 --2- 172.21.15.160:0/1225345689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f849014e200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f849007fde0 tx=0x7f84880091d0).ready entity=mon.0 client_cookie=dff411e821ba9ceb server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.619+0000 7f848f7fe700 1 -- 172.21.15.160:0/1225345689 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800b9c0 con 0x7f849014dd50 2020-11-20T12:22:30.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.619+0000 7f848f7fe700 1 -- 172.21.15.160:0/1225345689 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800bb20 con 0x7f849014dd50 2020-11-20T12:22:30.625 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.619+0000 7f848f7fe700 1 -- 172.21.15.160:0/1225345689 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800bea0 con 0x7f849014dd50 2020-11-20T12:22:30.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 -- 172.21.15.160:0/1225345689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 msgr2=0x7f849014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 --2- 172.21.15.160:0/1225345689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f849014e200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f849007fde0 tx=0x7f84880091d0).stop 2020-11-20T12:22:30.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 -- 172.21.15.160:0/1225345689 shutdown_connections 2020-11-20T12:22:30.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 --2- 172.21.15.160:0/1225345689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f849014e200 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 --2- 172.21.15.160:0/1225345689 >> v2:172.21.15.160:3300/0 conn(0x7f8490150ee0 0x7f84900c2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 -- 172.21.15.160:0/1225345689 >> 172.21.15.160:0/1225345689 conn(0x7f8490060140 msgr2=0x7f8490060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:30.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 -- 172.21.15.160:0/1225345689 shutdown_connections 2020-11-20T12:22:30.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.620+0000 7f8496f7d700 1 -- 172.21.15.160:0/1225345689 wait complete. 2020-11-20T12:22:30.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.623+0000 7f8496f7d700 1 Processor -- start 2020-11-20T12:22:30.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.623+0000 7f8496f7d700 1 -- start start 2020-11-20T12:22:30.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f8496f7d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84900c1e20 0x7f8490163ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f8496f7d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f84900bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f8496f7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8490150ee0 0x7f84901574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f8496f7d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84901644e0 con 0x7f849014dd50 2020-11-20T12:22:30.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f8496f7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900bd3f0 con 0x7f8490150ee0 2020-11-20T12:22:30.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f8496f7d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84901601a0 con 0x7f84900c1e20 2020-11-20T12:22:30.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f848ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f84900bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f8494d19700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84900c1e20 0x7f8490163ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f848ffff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f84900bcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33036/0 (socket says 172.21.15.160:33036) 2020-11-20T12:22:30.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f848ffff700 1 -- 172.21.15.160:0/3491656668 learned_addr learned my addr 172.21.15.160:0/3491656668 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:30.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.625+0000 7f849551a700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8490150ee0 0x7f84901574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848ffff700 1 -- 172.21.15.160:0/3491656668 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84900c1e20 msgr2=0x7f8490163ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848ffff700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84900c1e20 0x7f8490163ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848ffff700 1 -- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8490150ee0 msgr2=0x7f84901574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848ffff700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8490150ee0 0x7f84901574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848ffff700 1 -- 172.21.15.160:0/3491656668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490160440 con 0x7f849014dd50 2020-11-20T12:22:30.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848ffff700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f84900bcba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f847c00ed10 tx=0x7f847c006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c00cb00 con 0x7f849014dd50 2020-11-20T12:22:30.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c00cc60 con 0x7f849014dd50 2020-11-20T12:22:30.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84901606e0 con 0x7f849014dd50 2020-11-20T12:22:30.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c0123f0 con 0x7f849014dd50 2020-11-20T12:22:30.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.626+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8490160c20 con 0x7f849014dd50 2020-11-20T12:22:30.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.627+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f849005c940 con 0x7f849014dd50 2020-11-20T12:22:30.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.629+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f847c022070 con 0x7f849014dd50 2020-11-20T12:22:30.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.630+0000 7f848cff9700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8468080630 0x7f8468082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.630+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f847c0a34a0 con 0x7f849014dd50 2020-11-20T12:22:30.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.630+0000 7f848cff9700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8468088cd0 0x7f846808b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.630+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 --> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f846808b750 con 0x7f8468088cd0 2020-11-20T12:22:30.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.630+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f847c0a3820 con 0x7f849014dd50 2020-11-20T12:22:30.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.630+0000 7f8494d19700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8468080630 0x7f8468082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.630+0000 7f849551a700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8468088cd0 0x7f846808b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.631+0000 7f8494d19700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8468080630 0x7f8468082af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8484000bc0 tx=0x7f8484007a00).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.631+0000 7f849551a700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8468088cd0 0x7f846808b0f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.632+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== osd.1 v2:172.21.15.150:6802/21742 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f846808b750 con 0x7f8468088cd0 2020-11-20T12:22:30.649 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.647+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 --> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8490160e20 con 0x7f8468088cd0 2020-11-20T12:22:30.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.647+0000 7f848cff9700 1 -- 172.21.15.160:0/3491656668 <== osd.1 v2:172.21.15.150:6802/21742 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84880093a0 con 0x7f8468088cd0 2020-11-20T12:22:30.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8468088cd0 msgr2=0x7f846808b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6802/21742,v1:172.21.15.150:6803/21742] conn(0x7f8468088cd0 0x7f846808b0f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.651 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:30.651 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:30.651 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:30.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8468080630 msgr2=0x7f8468082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f8468080630 0x7f8468082af0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8484000bc0 tx=0x7f8484007a00).stop 2020-11-20T12:22:30.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 msgr2=0x7f84900bcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 --2- 172.21.15.160:0/3491656668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849014dd50 0x7f84900bcba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f847c00ed10 tx=0x7f847c006eb0).stop 2020-11-20T12:22:30.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f849551a700 1 -- 172.21.15.160:0/3491656668 reap_dead start 2020-11-20T12:22:30.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 shutdown_connections 2020-11-20T12:22:30.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 >> 172.21.15.160:0/3491656668 conn(0x7f8490060140 msgr2=0x7f84900631d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:30.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 shutdown_connections 2020-11-20T12:22:30.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.648+0000 7f8496f7d700 1 -- 172.21.15.160:0/3491656668 wait complete. 2020-11-20T12:22:30.673 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2020-11-20T12:22:30.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.890+0000 7fe4503f3700 1 Processor -- start 2020-11-20T12:22:30.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.890+0000 7fe4503f3700 1 -- start start 2020-11-20T12:22:30.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe4503f3700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fe4480c3270 0x7fe4480c3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe4503f3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe44814b930 0x7fe44814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe4503f3700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe448150370 con 0x7fe448151250 2020-11-20T12:22:30.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe4503f3700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4480bbe40 con 0x7fe4480c3270 2020-11-20T12:22:30.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe4503f3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4481505d0 con 0x7fe44814b930 2020-11-20T12:22:30.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe44d98e700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fe448151250 0x7fe4481516d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56334/0 (socket says 172.21.15.160:56334) 2020-11-20T12:22:30.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe44e990700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fe44814b930 0x7fe44814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.892+0000 7fe44d98e700 1 -- 172.21.15.160:0/1537977678 learned_addr learned my addr 172.21.15.160:0/1537977678 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:30.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.893+0000 7fe44e18f700 1 --2- 172.21.15.160:0/1537977678 >> v2:172.21.15.150:3300/0 conn(0x7fe4480c3270 0x7fe4480c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.893+0000 7fe44e990700 1 -- 172.21.15.160:0/1537977678 >> v2:172.21.15.150:3300/0 conn(0x7fe4480c3270 msgr2=0x7fe4480c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:30.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.893+0000 7fe44d18d700 1 -- 172.21.15.160:0/1537977678 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076921848 0 0) 0x7fe448150370 con 0x7fe448151250 2020-11-20T12:22:30.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.893+0000 7fe44e990700 1 --2- 172.21.15.160:0/1537977678 >> v2:172.21.15.150:3300/0 conn(0x7fe4480c3270 0x7fe4480c3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.893+0000 7fe44e990700 1 -- 172.21.15.160:0/1537977678 >> v1:172.21.15.160:6789/0 conn(0x7fe448151250 legacy=0x7fe4481516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.893+0000 7fe44e990700 1 -- 172.21.15.160:0/1537977678 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe448150870 con 0x7fe44814b930 2020-11-20T12:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe44e990700 1 --2- 172.21.15.160:0/1537977678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe44814b930 0x7fe44814bdc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe448067840 tx=0x7fe4400091d0).ready entity=mon.2 client_cookie=5528772c52af9650 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe44d18d700 1 -- 172.21.15.160:0/1537977678 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44000ba70 con 0x7fe44814b930 2020-11-20T12:22:30.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe44d18d700 1 -- 172.21.15.160:0/1537977678 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44000bbd0 con 0x7fe44814b930 2020-11-20T12:22:30.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe44d18d700 1 -- 172.21.15.160:0/1537977678 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440011400 con 0x7fe44814b930 2020-11-20T12:22:30.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe4503f3700 1 -- 172.21.15.160:0/1537977678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe44814b930 msgr2=0x7fe44814bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe4503f3700 1 --2- 172.21.15.160:0/1537977678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe44814b930 0x7fe44814bdc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe448067840 tx=0x7fe4400091d0).stop 2020-11-20T12:22:30.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe4503f3700 1 -- 172.21.15.160:0/1537977678 shutdown_connections 2020-11-20T12:22:30.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.894+0000 7fe4503f3700 1 --2- 172.21.15.160:0/1537977678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe44814b930 0x7fe44814bdc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.895+0000 7fe4503f3700 1 --2- 172.21.15.160:0/1537977678 >> v2:172.21.15.150:3300/0 conn(0x7fe4480c3270 0x7fe4480c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.895+0000 7fe4503f3700 1 -- 172.21.15.160:0/1537977678 >> 172.21.15.160:0/1537977678 conn(0x7fe4480b99a0 msgr2=0x7fe448060140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:30.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.895+0000 7fe4503f3700 1 -- 172.21.15.160:0/1537977678 shutdown_connections 2020-11-20T12:22:30.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.895+0000 7fe4503f3700 1 -- 172.21.15.160:0/1537977678 wait complete. 2020-11-20T12:22:30.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.897+0000 7fe4503f3700 1 Processor -- start 2020-11-20T12:22:30.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.897+0000 7fe4503f3700 1 -- start start 2020-11-20T12:22:30.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe4503f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4480c3270 0x7fe448140580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe4503f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe44814b930 0x7fe448137f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe4503f3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe448151250 0x7fe448138470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe4503f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe448138960 con 0x7fe44814b930 2020-11-20T12:22:30.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe4503f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44814de30 con 0x7fe4480c3270 2020-11-20T12:22:30.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe4503f3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44814e0d0 con 0x7fe448151250 2020-11-20T12:22:30.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe44e990700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe448151250 0x7fe448138470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe44e18f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4480c3270 0x7fe448140580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe44e18f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4480c3270 0x7fe448140580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51896/0 (socket says 172.21.15.160:51896) 2020-11-20T12:22:30.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe44e990700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe448151250 0x7fe448138470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38764/0 (socket says 172.21.15.160:38764) 2020-11-20T12:22:30.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe44e18f700 1 -- 172.21.15.160:0/2343097675 learned_addr learned my addr 172.21.15.160:0/2343097675 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:30.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.898+0000 7fe44d98e700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe44814b930 0x7fe448137f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44e18f700 1 -- 172.21.15.160:0/2343097675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe448151250 msgr2=0x7fe448138470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44e18f700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe448151250 0x7fe448138470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44e18f700 1 -- 172.21.15.160:0/2343097675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe44814b930 msgr2=0x7fe448137f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:30.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44e18f700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe44814b930 0x7fe448137f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:30.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44e18f700 1 -- 172.21.15.160:0/2343097675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44814e370 con 0x7fe4480c3270 2020-11-20T12:22:30.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44e990700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe448151250 0x7fe448138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:30.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44d98e700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe44814b930 0x7fe448137f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:30.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe44e18f700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4480c3270 0x7fe448140580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe44400eba0 tx=0x7fe444006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.899+0000 7fe4367fc700 1 -- 172.21.15.160:0/2343097675 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400c8e0 con 0x7fe4480c3270 2020-11-20T12:22:30.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.900+0000 7fe4367fc700 1 -- 172.21.15.160:0/2343097675 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44400ca40 con 0x7fe4480c3270 2020-11-20T12:22:30.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.900+0000 7fe4367fc700 1 -- 172.21.15.160:0/2343097675 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400cdc0 con 0x7fe4480c3270 2020-11-20T12:22:30.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.900+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44814e610 con 0x7fe4480c3270 2020-11-20T12:22:30.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.900+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44814eb50 con 0x7fe4480c3270 2020-11-20T12:22:30.912 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.901+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe448069460 con 0x7fe4480c3270 2020-11-20T12:22:30.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.902+0000 7fe4367fc700 1 -- 172.21.15.160:0/2343097675 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fe444012600 con 0x7fe4480c3270 2020-11-20T12:22:30.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.903+0000 7fe4367fc700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe420080630 0x7fe420082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:30.913 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.903+0000 7fe4367fc700 1 -- 172.21.15.160:0/2343097675 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fe4440a2c30 con 0x7fe4480c3270 2020-11-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.904+0000 7fe44d98e700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe420080630 0x7fe420082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.904+0000 7fe44d98e700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe420080630 0x7fe420082af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe4480bd900 tx=0x7fe438009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:30.914 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:30.907+0000 7fe4367fc700 1 -- 172.21.15.160:0/2343097675 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fe444077830 con 0x7fe4480c3270 2020-11-20T12:22:31.095 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.092+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe448138e50 con 0x7fe420080630 2020-11-20T12:22:31.096 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.093+0000 7fe4367fc700 1 -- 172.21.15.160:0/2343097675 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe448138e50 con 0x7fe420080630 2020-11-20T12:22:31.098 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe420080630 msgr2=0x7fe420082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe420080630 0x7fe420082af0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe4480bd900 tx=0x7fe438009040).stop 2020-11-20T12:22:31.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4480c3270 msgr2=0x7fe448140580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4480c3270 0x7fe448140580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe44400eba0 tx=0x7fe444006df0).stop 2020-11-20T12:22:31.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 shutdown_connections 2020-11-20T12:22:31.099 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fe420080630 0x7fe420082af0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe448151250 0x7fe448138470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4480c3270 0x7fe448140580 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 --2- 172.21.15.160:0/2343097675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe44814b930 0x7fe448137f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.100 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 >> 172.21.15.160:0/2343097675 conn(0x7fe4480b99a0 msgr2=0x7fe4480c03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:31.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 shutdown_connections 2020-11-20T12:22:31.101 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.095+0000 7fe4503f3700 1 -- 172.21.15.160:0/2343097675 wait complete. 2020-11-20T12:22:31.101 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 1 to deep-scrub 2020-11-20T12:22:31.122 INFO:tasks.ceph:Scrubbing osd.4 2020-11-20T12:22:31.122 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:31.390 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.387+0000 7fd150ab3700 1 Processor -- start 2020-11-20T12:22:31.391 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.387+0000 7fd150ab3700 1 -- start start 2020-11-20T12:22:31.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd150ab3700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd14c0c3e30 0x7fd14c0c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.392 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd150ab3700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fd14c0627c0 0x7fd14c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd150ab3700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14c064e10 con 0x7fd14c150cb0 2020-11-20T12:22:31.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd150ab3700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c065e90 con 0x7fd14c0627c0 2020-11-20T12:22:31.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd150ab3700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c151540 con 0x7fd14c0c3e30 2020-11-20T12:22:31.393 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd14b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd14c0c3e30 0x7fd14c0c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd14b7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fd14c0c3e30 0x7fd14c0c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38768/0 (socket says 172.21.15.160:38768) 2020-11-20T12:22:31.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.389+0000 7fd14b7fe700 1 -- 172.21.15.160:0/1732954032 learned_addr learned my addr 172.21.15.160:0/1732954032 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:31.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.390+0000 7fd14affd700 1 --2- 172.21.15.160:0/1732954032 >> v2:172.21.15.134:3300/0 conn(0x7fd14c0627c0 0x7fd14c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.390+0000 7fd14affd700 1 -- 172.21.15.160:0/1732954032 >> v2:172.21.15.160:3300/0 conn(0x7fd14c0c3e30 msgr2=0x7fd14c0c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:31.395 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.390+0000 7fd14affd700 1 --2- 172.21.15.160:0/1732954032 >> v2:172.21.15.160:3300/0 conn(0x7fd14c0c3e30 0x7fd14c0c1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.390+0000 7fd14affd700 1 -- 172.21.15.160:0/1732954032 >> v1:172.21.15.134:6789/0 conn(0x7fd14c150cb0 legacy=0x7fd14c065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:31.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.390+0000 7fd14affd700 1 -- 172.21.15.160:0/1732954032 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c1517e0 con 0x7fd14c0627c0 2020-11-20T12:22:31.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.391+0000 7fd14affd700 1 --2- 172.21.15.160:0/1732954032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0627c0 0x7fd14c0c4210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd14c0c83a0 tx=0x7fd140006df0).ready entity=mon.0 client_cookie=17c2a0d776911ee server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:31.396 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd14a7fc700 1 -- 172.21.15.160:0/1732954032 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1400097b0 con 0x7fd14c0627c0 2020-11-20T12:22:31.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd14a7fc700 1 -- 172.21.15.160:0/1732954032 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140009910 con 0x7fd14c0627c0 2020-11-20T12:22:31.397 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd14a7fc700 1 -- 172.21.15.160:0/1732954032 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140009c90 con 0x7fd14c0627c0 2020-11-20T12:22:31.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd150ab3700 1 -- 172.21.15.160:0/1732954032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0627c0 msgr2=0x7fd14c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd150ab3700 1 --2- 172.21.15.160:0/1732954032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0627c0 0x7fd14c0c4210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fd14c0c83a0 tx=0x7fd140006df0).stop 2020-11-20T12:22:31.398 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd150ab3700 1 -- 172.21.15.160:0/1732954032 shutdown_connections 2020-11-20T12:22:31.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd150ab3700 1 --2- 172.21.15.160:0/1732954032 >> v2:172.21.15.160:3300/0 conn(0x7fd14c0c3e30 0x7fd14c0c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd150ab3700 1 --2- 172.21.15.160:0/1732954032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0627c0 0x7fd14c0c4210 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.392+0000 7fd150ab3700 1 -- 172.21.15.160:0/1732954032 >> 172.21.15.160:0/1732954032 conn(0x7fd14c062ed0 msgr2=0x7fd14c0632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:31.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.393+0000 7fd150ab3700 1 -- 172.21.15.160:0/1732954032 shutdown_connections 2020-11-20T12:22:31.399 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.393+0000 7fd150ab3700 1 -- 172.21.15.160:0/1732954032 wait complete. 2020-11-20T12:22:31.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.395+0000 7fd150ab3700 1 Processor -- start 2020-11-20T12:22:31.400 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.395+0000 7fd150ab3700 1 -- start start 2020-11-20T12:22:31.401 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd150ab3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0c3e30 0x7fd14c152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd150ab3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd14c150cb0 0x7fd14c146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd150ab3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd14c14c030 0x7fd14c147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd150ab3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0c5340 con 0x7fd14c0c3e30 2020-11-20T12:22:31.402 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd150ab3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0c55e0 con 0x7fd14c150cb0 2020-11-20T12:22:31.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd150ab3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0c5880 con 0x7fd14c14c030 2020-11-20T12:22:31.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd14bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd14c14c030 0x7fd14c147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd14b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0c3e30 0x7fd14c152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd14affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd14c150cb0 0x7fd14c146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.403 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd14b7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0c3e30 0x7fd14c152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33066/0 (socket says 172.21.15.160:33066) 2020-11-20T12:22:31.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd14affd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd14c150cb0 0x7fd14c146d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51910/0 (socket says 172.21.15.160:51910) 2020-11-20T12:22:31.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.396+0000 7fd14b7fe700 1 -- 172.21.15.160:0/991169443 learned_addr learned my addr 172.21.15.160:0/991169443 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:31.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd14affd700 1 -- 172.21.15.160:0/991169443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd14c14c030 msgr2=0x7fd14c147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd14affd700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd14c14c030 0x7fd14c147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.404 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd14affd700 1 -- 172.21.15.160:0/991169443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0c3e30 msgr2=0x7fd14c152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.405 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd14affd700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd14c0c3e30 0x7fd14c152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.405 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd14affd700 1 -- 172.21.15.160:0/991169443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c0c5b20 con 0x7fd14c150cb0 2020-11-20T12:22:31.405 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd14affd700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd14c150cb0 0x7fd14c146d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd140012000 tx=0x7fd140015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:31.405 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140011c80 con 0x7fd14c150cb0 2020-11-20T12:22:31.405 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140011de0 con 0x7fd14c150cb0 2020-11-20T12:22:31.406 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14001e670 con 0x7fd14c150cb0 2020-11-20T12:22:31.406 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.397+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14c0c5dc0 con 0x7fd14c150cb0 2020-11-20T12:22:31.406 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.398+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c0c6430 con 0x7fd14c150cb0 2020-11-20T12:22:31.406 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.399+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd14c069460 con 0x7fd14c150cb0 2020-11-20T12:22:31.407 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.401+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd14002e070 con 0x7fd14c150cb0 2020-11-20T12:22:31.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.402+0000 7fd12b7fe700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd124080630 0x7fd124082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.402+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fd1400a4630 con 0x7fd14c150cb0 2020-11-20T12:22:31.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.402+0000 7fd12b7fe700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fd124088cd0 0x7fd12408b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.402+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 --> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd12408b750 con 0x7fd124088cd0 2020-11-20T12:22:31.408 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.402+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1400a4a30 con 0x7fd14c150cb0 2020-11-20T12:22:31.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.402+0000 7fd14b7fe700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd124080630 0x7fd124082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.403+0000 7fd14bfff700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fd124088cd0 0x7fd12408b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.403+0000 7fd14b7fe700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd124080630 0x7fd124082af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fd13c00bbd0 tx=0x7fd13c008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:31.409 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.403+0000 7fd14bfff700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fd124088cd0 0x7fd12408b0f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:31.410 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.404+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== osd.4 v2:172.21.15.150:6818/21785 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fd12408b750 con 0x7fd124088cd0 2020-11-20T12:22:31.424 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.419+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 --> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd14c0c5f50 con 0x7fd124088cd0 2020-11-20T12:22:31.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.420+0000 7fd12b7fe700 1 -- 172.21.15.160:0/991169443 <== osd.4 v2:172.21.15.150:6818/21785 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd14c0c5f50 con 0x7fd124088cd0 2020-11-20T12:22:31.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.420+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fd124088cd0 msgr2=0x7fd12408b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.420+0000 7fd150ab3700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6818/21785,v1:172.21.15.150:6819/21785] conn(0x7fd124088cd0 0x7fd12408b0f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.420+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd124080630 msgr2=0x7fd124082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.420+0000 7fd150ab3700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fd124080630 0x7fd124082af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fd13c00bbd0 tx=0x7fd13c008040).stop 2020-11-20T12:22:31.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.420+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd14c150cb0 msgr2=0x7fd14c146d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.420+0000 7fd150ab3700 1 --2- 172.21.15.160:0/991169443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd14c150cb0 0x7fd14c146d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fd140012000 tx=0x7fd140015000).stop 2020-11-20T12:22:31.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.421+0000 7fd14bfff700 1 -- 172.21.15.160:0/991169443 reap_dead start 2020-11-20T12:22:31.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.421+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 shutdown_connections 2020-11-20T12:22:31.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.421+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 >> 172.21.15.160:0/991169443 conn(0x7fd14c062ed0 msgr2=0x7fd14c0656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:31.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.421+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 shutdown_connections 2020-11-20T12:22:31.428 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.421+0000 7fd150ab3700 1 -- 172.21.15.160:0/991169443 wait complete. 2020-11-20T12:22:31.428 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:31.428 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:31.429 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:31.443 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2020-11-20T12:22:31.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.667+0000 7efdf7fff700 1 Processor -- start 2020-11-20T12:22:31.671 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.668+0000 7efdf7fff700 1 -- start start 2020-11-20T12:22:31.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.669+0000 7efdf7fff700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efdf80bfe00 0x7efdf8065330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.669+0000 7efdf7fff700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7efdf8150c70 0x7efdf81510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.672 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.669+0000 7efdf7fff700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf80c0260 con 0x7efdf80bfa20 2020-11-20T12:22:31.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.669+0000 7efdf7fff700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf8065820 con 0x7efdf8150c70 2020-11-20T12:22:31.673 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.669+0000 7efdf7fff700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf80bb600 con 0x7efdf80bfe00 2020-11-20T12:22:31.674 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.669+0000 7efdee7fc700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7efdf80bfe00 0x7efdf8065330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.669+0000 7efdf6ffd700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7efdf80bfa20 0x7efdf80baef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47628/0 (socket says 172.21.15.160:47628) 2020-11-20T12:22:31.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdf6ffd700 1 -- 172.21.15.160:0/2076613825 learned_addr learned my addr 172.21.15.160:0/2076613825 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:31.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdf77fe700 1 --2- 172.21.15.160:0/2076613825 >> v2:172.21.15.134:3300/0 conn(0x7efdf8150c70 0x7efdf81510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.675 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdf67fc700 1 -- 172.21.15.160:0/2076613825 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089025259 0 0) 0x7efde8001450 con 0x7efdf80bfa20 2020-11-20T12:22:31.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdf67fc700 1 -- 172.21.15.160:0/2076613825 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd8003240 con 0x7efdf80bfa20 2020-11-20T12:22:31.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdee7fc700 1 -- 172.21.15.160:0/2076613825 >> v2:172.21.15.134:3300/0 conn(0x7efdf8150c70 msgr2=0x7efdf81510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:31.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdee7fc700 1 --2- 172.21.15.160:0/2076613825 >> v2:172.21.15.134:3300/0 conn(0x7efdf8150c70 0x7efdf81510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdee7fc700 1 -- 172.21.15.160:0/2076613825 >> v1:172.21.15.150:6789/0 conn(0x7efdf80bfa20 legacy=0x7efdf80baef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.676 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdee7fc700 1 -- 172.21.15.160:0/2076613825 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80bb890 con 0x7efdf80bfe00 2020-11-20T12:22:31.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdf77fe700 1 --2- 172.21.15.160:0/2076613825 >> v2:172.21.15.134:3300/0 conn(0x7efdf8150c70 0x7efdf81510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:31.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.670+0000 7efdee7fc700 1 --2- 172.21.15.160:0/2076613825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf80bfe00 0x7efdf8065330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7efdf8067690 tx=0x7efde0006df0).ready entity=mon.1 client_cookie=b952f3f804d538f9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:31.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf67fc700 1 -- 172.21.15.160:0/2076613825 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0009640 con 0x7efdf80bfe00 2020-11-20T12:22:31.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf67fc700 1 -- 172.21.15.160:0/2076613825 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde00097a0 con 0x7efdf80bfe00 2020-11-20T12:22:31.677 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf67fc700 1 -- 172.21.15.160:0/2076613825 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0009b20 con 0x7efdf80bfe00 2020-11-20T12:22:31.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf7fff700 1 -- 172.21.15.160:0/2076613825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf80bfe00 msgr2=0x7efdf8065330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2076613825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf80bfe00 0x7efdf8065330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7efdf8067690 tx=0x7efde0006df0).stop 2020-11-20T12:22:31.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf7fff700 1 -- 172.21.15.160:0/2076613825 shutdown_connections 2020-11-20T12:22:31.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2076613825 >> v2:172.21.15.134:3300/0 conn(0x7efdf8150c70 0x7efdf81510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.678 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2076613825 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf80bfe00 0x7efdf8065330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf7fff700 1 -- 172.21.15.160:0/2076613825 >> 172.21.15.160:0/2076613825 conn(0x7efdf8062ef0 msgr2=0x7efdf8063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:31.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.671+0000 7efdf7fff700 1 -- 172.21.15.160:0/2076613825 shutdown_connections 2020-11-20T12:22:31.679 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.672+0000 7efdf7fff700 1 -- 172.21.15.160:0/2076613825 wait complete. 2020-11-20T12:22:31.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.673+0000 7efdf7fff700 1 Processor -- start 2020-11-20T12:22:31.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.673+0000 7efdf7fff700 1 -- start start 2020-11-20T12:22:31.681 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efdf80bfa20 0x7efdf80c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdf80bfe00 0x7efdf81506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf7fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf8150c70 0x7efdf8163460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf7fff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf80c1280 con 0x7efdf80bfe00 2020-11-20T12:22:31.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf7fff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf815ff20 con 0x7efdf8150c70 2020-11-20T12:22:31.682 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf7fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf814ef30 con 0x7efdf80bfa20 2020-11-20T12:22:31.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf6ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efdf80bfa20 0x7efdf80c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf6ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efdf80bfa20 0x7efdf80c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38790/0 (socket says 172.21.15.160:38790) 2020-11-20T12:22:31.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf6ffd700 1 -- 172.21.15.160:0/2248349631 learned_addr learned my addr 172.21.15.160:0/2248349631 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:31.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdf77fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf8150c70 0x7efdf8163460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.683 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.674+0000 7efdee7fc700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdf80bfe00 0x7efdf81506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdee7fc700 1 -- 172.21.15.160:0/2248349631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efdf80bfa20 msgr2=0x7efdf80c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdee7fc700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efdf80bfa20 0x7efdf80c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdee7fc700 1 -- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf8150c70 msgr2=0x7efdf8163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdee7fc700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf8150c70 0x7efdf8163460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.684 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdee7fc700 1 -- 172.21.15.160:0/2248349631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf8163950 con 0x7efdf80bfe00 2020-11-20T12:22:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdf77fe700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf8150c70 0x7efdf8163460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdee7fc700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdf80bfe00 0x7efdf81506a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7efde0012000 tx=0x7efde0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdef7fe700 1 -- 172.21.15.160:0/2248349631 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0011c40 con 0x7efdf80bfe00 2020-11-20T12:22:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.675+0000 7efdef7fe700 1 -- 172.21.15.160:0/2248349631 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0011da0 con 0x7efdf80bfe00 2020-11-20T12:22:31.685 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.676+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf814f190 con 0x7efdf80bfe00 2020-11-20T12:22:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.676+0000 7efdef7fe700 1 -- 172.21.15.160:0/2248349631 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde001e670 con 0x7efdf80bfe00 2020-11-20T12:22:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.676+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf814f6d0 con 0x7efdf80bfe00 2020-11-20T12:22:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.677+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8044f60 con 0x7efdf80bfe00 2020-11-20T12:22:31.686 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.678+0000 7efdef7fe700 1 -- 172.21.15.160:0/2248349631 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7efde0025030 con 0x7efdf80bfe00 2020-11-20T12:22:31.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.679+0000 7efdef7fe700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7efdd4080630 0x7efdd4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:31.687 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.680+0000 7efdef7fe700 1 -- 172.21.15.160:0/2248349631 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7efde00a3e70 con 0x7efdf80bfe00 2020-11-20T12:22:31.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.680+0000 7efdf6ffd700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7efdd4080630 0x7efdd4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:31.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.681+0000 7efdf6ffd700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7efdd4080630 0x7efdd4082af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efde8001e80 tx=0x7efde8009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:31.688 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.683+0000 7efdef7fe700 1 -- 172.21.15.160:0/2248349631 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7efde0078940 con 0x7efdf80bfe00 2020-11-20T12:22:31.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.879+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf8060d50 con 0x7efdd4080630 2020-11-20T12:22:31.883 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.880+0000 7efdef7fe700 1 -- 172.21.15.160:0/2248349631 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efdf8060d50 con 0x7efdd4080630 2020-11-20T12:22:31.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7efdd4080630 msgr2=0x7efdd4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7efdd4080630 0x7efdd4082af0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7efde8001e80 tx=0x7efde8009040).stop 2020-11-20T12:22:31.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdf80bfe00 msgr2=0x7efdf81506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:31.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdf80bfe00 0x7efdf81506a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7efde0012000 tx=0x7efde0015000).stop 2020-11-20T12:22:31.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 shutdown_connections 2020-11-20T12:22:31.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7efdd4080630 0x7efdd4082af0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efdf8150c70 0x7efdf8163460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efdf80bfa20 0x7efdf80c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 --2- 172.21.15.160:0/2248349631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efdf80bfe00 0x7efdf81506a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:31.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 >> 172.21.15.160:0/2248349631 conn(0x7efdf8062ef0 msgr2=0x7efdf8065960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:31.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 shutdown_connections 2020-11-20T12:22:31.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:31.882+0000 7efdf7fff700 1 -- 172.21.15.160:0/2248349631 wait complete. 2020-11-20T12:22:31.889 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 4 to deep-scrub 2020-11-20T12:22:31.906 INFO:tasks.ceph:Scrubbing osd.7 2020-11-20T12:22:31.906 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:32.134 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.131+0000 7f61ff59e700 1 Processor -- start 2020-11-20T12:22:32.134 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.131+0000 7f61ff59e700 1 -- start start 2020-11-20T12:22:32.137 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.133+0000 7f61ff59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f6200061870 0x7f620014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.137 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.133+0000 7f61ff59e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62000ba9d0 con 0x7f620014b9e0 2020-11-20T12:22:32.137 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.133+0000 7f61ff59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62000bac30 con 0x7f6200061c50 2020-11-20T12:22:32.137 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.133+0000 7f61ff59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000baed0 con 0x7f6200061870 2020-11-20T12:22:32.138 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61f5d9b700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f6200061c50 0x7f62000ba2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56382/0 (socket says 172.21.15.160:56382) 2020-11-20T12:22:32.138 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61f5d9b700 1 -- 172.21.15.160:0/2625593790 learned_addr learned my addr 172.21.15.160:0/2625593790 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:32.138 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61fed9d700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7f620014b9e0 0x7f620014be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:32876/0 (socket says 172.21.15.160:32876) 2020-11-20T12:22:32.138 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61fe59c700 1 --2- 172.21.15.160:0/2625593790 >> v2:172.21.15.160:3300/0 conn(0x7f6200061870 0x7f620014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.140 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61fdd9b700 1 -- 172.21.15.160:0/2625593790 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186436991 0 0) 0x7f62000ba9d0 con 0x7f620014b9e0 2020-11-20T12:22:32.140 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61fdd9b700 1 -- 172.21.15.160:0/2625593790 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e0003240 con 0x7f620014b9e0 2020-11-20T12:22:32.140 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61fdd9b700 1 -- 172.21.15.160:0/2625593790 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969226838 0 0) 0x7f62000bac30 con 0x7f6200061c50 2020-11-20T12:22:32.140 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.134+0000 7f61fdd9b700 1 -- 172.21.15.160:0/2625593790 --> v1:172.21.15.160:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62000ba9d0 con 0x7f6200061c50 2020-11-20T12:22:32.141 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.135+0000 7f61fe59c700 1 -- 172.21.15.160:0/2625593790 >> v1:172.21.15.160:6789/0 conn(0x7f6200061c50 legacy=0x7f62000ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.141 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.135+0000 7f61fe59c700 1 -- 172.21.15.160:0/2625593790 >> v1:172.21.15.134:6789/0 conn(0x7f620014b9e0 legacy=0x7f620014be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.141 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.135+0000 7f61fe59c700 1 -- 172.21.15.160:0/2625593790 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62000bb170 con 0x7f6200061870 2020-11-20T12:22:32.141 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.135+0000 7f61fe59c700 1 --2- 172.21.15.160:0/2625593790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6200061870 0x7f620014e9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f61f000b9a0 tx=0x7f61f0006df0).ready entity=mon.2 client_cookie=3279f70080a75eb8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.141 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.135+0000 7f61fdd9b700 1 -- 172.21.15.160:0/2625593790 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0009680 con 0x7f6200061870 2020-11-20T12:22:32.142 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.135+0000 7f61fdd9b700 1 -- 172.21.15.160:0/2625593790 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00097e0 con 0x7f6200061870 2020-11-20T12:22:32.142 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.135+0000 7f61fdd9b700 1 -- 172.21.15.160:0/2625593790 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0009b60 con 0x7f6200061870 2020-11-20T12:22:32.142 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.136+0000 7f61ff59e700 1 -- 172.21.15.160:0/2625593790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6200061870 msgr2=0x7f620014e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.142 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.136+0000 7f61ff59e700 1 --2- 172.21.15.160:0/2625593790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6200061870 0x7f620014e9b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f61f000b9a0 tx=0x7f61f0006df0).stop 2020-11-20T12:22:32.142 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.136+0000 7f61ff59e700 1 -- 172.21.15.160:0/2625593790 shutdown_connections 2020-11-20T12:22:32.143 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.136+0000 7f61ff59e700 1 --2- 172.21.15.160:0/2625593790 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6200061870 0x7f620014e9b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.143 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.136+0000 7f61ff59e700 1 -- 172.21.15.160:0/2625593790 >> 172.21.15.160:0/2625593790 conn(0x7f62000c2f70 msgr2=0x7f62000c3380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:32.143 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.136+0000 7f61ff59e700 1 -- 172.21.15.160:0/2625593790 shutdown_connections 2020-11-20T12:22:32.145 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.136+0000 7f61ff59e700 1 -- 172.21.15.160:0/2625593790 wait complete. 2020-11-20T12:22:32.145 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.138+0000 7f61ff59e700 1 Processor -- start 2020-11-20T12:22:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.139+0000 7f61ff59e700 1 -- start start 2020-11-20T12:22:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61ff59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6200061870 0x7f62000651e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61ff59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200061c50 0x7f6200160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61ff59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f620014b9e0 0x7f620010ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.146 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61ff59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000656d0 con 0x7f6200061c50 2020-11-20T12:22:32.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61ff59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6200112f30 con 0x7f6200061870 2020-11-20T12:22:32.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61ff59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62001131d0 con 0x7f620014b9e0 2020-11-20T12:22:32.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61fed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f620014b9e0 0x7f620010ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61fe59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6200061870 0x7f62000651e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.147 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.140+0000 7f61f5d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200061c50 0x7f6200160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61fed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f620014b9e0 0x7f620010ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38808/0 (socket says 172.21.15.160:38808) 2020-11-20T12:22:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200061c50 0x7f6200160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33096/0 (socket says 172.21.15.160:33096) 2020-11-20T12:22:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 -- 172.21.15.160:0/2865966969 learned_addr learned my addr 172.21.15.160:0/2865966969 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61fe59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6200061870 0x7f62000651e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51940/0 (socket says 172.21.15.160:51940) 2020-11-20T12:22:32.148 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 -- 172.21.15.160:0/2865966969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f620014b9e0 msgr2=0x7f620010ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f620014b9e0 0x7f620010ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 -- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6200061870 msgr2=0x7f62000651e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6200061870 0x7f62000651e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 -- 172.21.15.160:0/2865966969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6200113470 con 0x7f6200061c50 2020-11-20T12:22:32.149 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61fe59c700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6200061870 0x7f62000651e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:32.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f5d9b700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200061c50 0x7f6200160fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f61e800c710 tx=0x7f61e8007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80072e0 con 0x7f6200061c50 2020-11-20T12:22:32.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8007440 con 0x7f6200061c50 2020-11-20T12:22:32.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.141+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6200064800 con 0x7f6200061c50 2020-11-20T12:22:32.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.142+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8005820 con 0x7f6200061c50 2020-11-20T12:22:32.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.142+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6200064d40 con 0x7f6200061c50 2020-11-20T12:22:32.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.142+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6200069460 con 0x7f6200061c50 2020-11-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.144+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f61e8010070 con 0x7f6200061c50 2020-11-20T12:22:32.152 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.145+0000 7f61f6ffd700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f61dc080660 0x7f61dc082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.145+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f61e80a2640 con 0x7f6200061c50 2020-11-20T12:22:32.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.145+0000 7f61f6ffd700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7f61dc088d00 0x7f61dc08b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.145+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 --> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f61dc08b780 con 0x7f61dc088d00 2020-11-20T12:22:32.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.145+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61e80a2930 con 0x7f6200061c50 2020-11-20T12:22:32.153 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.145+0000 7f61fe59c700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f61dc080660 0x7f61dc082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.146+0000 7f61fed9d700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7f61dc088d00 0x7f61dc08b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.146+0000 7f61fe59c700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f61dc080660 0x7f61dc082b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f61f0006b80 tx=0x7f61f0015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.154 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.146+0000 7f61fed9d700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7f61dc088d00 0x7f61dc08b120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.155 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.147+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== osd.7 v2:172.21.15.150:6824/21826 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f61dc08b780 con 0x7f61dc088d00 2020-11-20T12:22:32.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.169+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 --> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6200064ed0 con 0x7f61dc088d00 2020-11-20T12:22:32.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61f6ffd700 1 -- 172.21.15.160:0/2865966969 <== osd.7 v2:172.21.15.150:6824/21826 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6200064ed0 con 0x7f61dc088d00 2020-11-20T12:22:32.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7f61dc088d00 msgr2=0x7f61dc08b120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61ff59e700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6824/21826,v1:172.21.15.150:6826/21826] conn(0x7f61dc088d00 0x7f61dc08b120 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f61dc080660 msgr2=0x7f61dc082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61ff59e700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f61dc080660 0x7f61dc082b20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f61f0006b80 tx=0x7f61f0015000).stop 2020-11-20T12:22:32.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200061c50 msgr2=0x7f6200160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61ff59e700 1 --2- 172.21.15.160:0/2865966969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6200061c50 0x7f6200160fe0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f61e800c710 tx=0x7f61e8007a60).stop 2020-11-20T12:22:32.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.170+0000 7f61fed9d700 1 -- 172.21.15.160:0/2865966969 reap_dead start 2020-11-20T12:22:32.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.171+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 shutdown_connections 2020-11-20T12:22:32.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.171+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 >> 172.21.15.160:0/2865966969 conn(0x7f62000c2f70 msgr2=0x7f620014be50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:32.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.171+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 shutdown_connections 2020-11-20T12:22:32.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.171+0000 7f61ff59e700 1 -- 172.21.15.160:0/2865966969 wait complete. 2020-11-20T12:22:32.176 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:32.176 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:32.177 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:32.194 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2020-11-20T12:22:32.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.420+0000 7f6b09354700 1 Processor -- start 2020-11-20T12:22:32.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.420+0000 7f6b09354700 1 -- start start 2020-11-20T12:22:32.441 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.422+0000 7f6b09354700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f6b04063490 0x7f6b040c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.422+0000 7f6b09354700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b040c3a80 con 0x7f6b0414fc90 2020-11-20T12:22:32.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.422+0000 7f6b09354700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b040c3d10 con 0x7f6b040630b0 2020-11-20T12:22:32.442 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.422+0000 7f6b09354700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b040c4c30 con 0x7f6b04063490 2020-11-20T12:22:32.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.422+0000 7f6b03fff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7f6b040630b0 0x7f6b040c24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47658/0 (socket says 172.21.15.160:47658) 2020-11-20T12:22:32.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.422+0000 7f6b03fff700 1 -- 172.21.15.160:0/3026404902 learned_addr learned my addr 172.21.15.160:0/3026404902 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:32.443 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.422+0000 7f6b037fe700 1 --2- 172.21.15.160:0/3026404902 >> v2:172.21.15.134:3300/0 conn(0x7f6b04063490 0x7f6b040c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b02ffd700 1 -- 172.21.15.160:0/3026404902 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941230689 0 0) 0x7f6b040c3d10 con 0x7f6b040630b0 2020-11-20T12:22:32.444 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b02ffd700 1 -- 172.21.15.160:0/3026404902 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af0003240 con 0x7f6b040630b0 2020-11-20T12:22:32.445 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b02ffd700 1 -- 172.21.15.160:0/3026404902 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587801667 0 0) 0x7f6b040c3a80 con 0x7f6b0414fc90 2020-11-20T12:22:32.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b02ffd700 1 -- 172.21.15.160:0/3026404902 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b040c3d10 con 0x7f6b0414fc90 2020-11-20T12:22:32.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b037fe700 1 -- 172.21.15.160:0/3026404902 >> v1:172.21.15.150:6789/0 conn(0x7f6b040630b0 legacy=0x7f6b040c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.446 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b037fe700 1 -- 172.21.15.160:0/3026404902 >> v1:172.21.15.134:6789/0 conn(0x7f6b0414fc90 legacy=0x7f6b04150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.447 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b037fe700 1 -- 172.21.15.160:0/3026404902 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b040c3fb0 con 0x7f6b04063490 2020-11-20T12:22:32.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b037fe700 1 --2- 172.21.15.160:0/3026404902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b040c2be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6af800b9a0 tx=0x7f6af8006df0).ready entity=mon.0 client_cookie=c119efd8173e3300 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.448 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b02ffd700 1 -- 172.21.15.160:0/3026404902 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8009710 con 0x7f6b04063490 2020-11-20T12:22:32.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b02ffd700 1 -- 172.21.15.160:0/3026404902 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8009870 con 0x7f6b04063490 2020-11-20T12:22:32.449 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.423+0000 7f6b02ffd700 1 -- 172.21.15.160:0/3026404902 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8009bf0 con 0x7f6b04063490 2020-11-20T12:22:32.450 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.424+0000 7f6b09354700 1 -- 172.21.15.160:0/3026404902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 msgr2=0x7f6b040c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.424+0000 7f6b09354700 1 --2- 172.21.15.160:0/3026404902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b040c2be0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f6af800b9a0 tx=0x7f6af8006df0).stop 2020-11-20T12:22:32.451 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.424+0000 7f6b09354700 1 -- 172.21.15.160:0/3026404902 shutdown_connections 2020-11-20T12:22:32.453 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.424+0000 7f6b09354700 1 --2- 172.21.15.160:0/3026404902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b040c2be0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.456 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.424+0000 7f6b09354700 1 -- 172.21.15.160:0/3026404902 >> 172.21.15.160:0/3026404902 conn(0x7f6b04060140 msgr2=0x7f6b04060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:32.457 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.424+0000 7f6b09354700 1 -- 172.21.15.160:0/3026404902 shutdown_connections 2020-11-20T12:22:32.458 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.424+0000 7f6b09354700 1 -- 172.21.15.160:0/3026404902 wait complete. 2020-11-20T12:22:32.459 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.425+0000 7f6b09354700 1 Processor -- start 2020-11-20T12:22:32.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.426+0000 7f6b09354700 1 -- start start 2020-11-20T12:22:32.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.426+0000 7f6b09354700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b040630b0 0x7f6b04163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.462 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.426+0000 7f6b09354700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b0414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b09354700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0414fc90 0x7f6b04111bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.463 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b09354700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b040c5830 con 0x7f6b04063490 2020-11-20T12:22:32.464 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b09354700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0415fe10 con 0x7f6b0414fc90 2020-11-20T12:22:32.464 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b09354700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b041600b0 con 0x7f6b040630b0 2020-11-20T12:22:32.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b03fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b040630b0 0x7f6b04163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b0414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.465 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b0414d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33112/0 (socket says 172.21.15.160:33112) 2020-11-20T12:22:32.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 -- 172.21.15.160:0/1576807324 learned_addr learned my addr 172.21.15.160:0/1576807324 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:32.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b08b53700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0414fc90 0x7f6b04111bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.466 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 -- 172.21.15.160:0/1576807324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b040630b0 msgr2=0x7f6b04163ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b040630b0 0x7f6b04163ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.467 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 -- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0414fc90 msgr2=0x7f6b04111bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0414fc90 0x7f6b04111bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b037fe700 1 -- 172.21.15.160:0/1576807324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04160350 con 0x7f6b04063490 2020-11-20T12:22:32.468 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.427+0000 7f6b08b53700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0414fc90 0x7f6b04111bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:32.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.428+0000 7f6b037fe700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b0414d140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6af8009fd0 tx=0x7f6af8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.469 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.428+0000 7f6ae3fff700 1 -- 172.21.15.160:0/1576807324 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8011d80 con 0x7f6b04063490 2020-11-20T12:22:32.470 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.428+0000 7f6ae3fff700 1 -- 172.21.15.160:0/1576807324 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af801e460 con 0x7f6b04063490 2020-11-20T12:22:32.470 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.428+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b041605f0 con 0x7f6b04063490 2020-11-20T12:22:32.470 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.428+0000 7f6ae3fff700 1 -- 172.21.15.160:0/1576807324 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af801e7e0 con 0x7f6b04063490 2020-11-20T12:22:32.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.428+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b04160b30 con 0x7f6b04063490 2020-11-20T12:22:32.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.429+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b04160cc0 con 0x7f6b04063490 2020-11-20T12:22:32.471 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.430+0000 7f6ae3fff700 1 -- 172.21.15.160:0/1576807324 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6af801a040 con 0x7f6b04063490 2020-11-20T12:22:32.472 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.431+0000 7f6ae3fff700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6adc080630 0x7f6adc082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.472 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.431+0000 7f6ae3fff700 1 -- 172.21.15.160:0/1576807324 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f6af80a3fe0 con 0x7f6b04063490 2020-11-20T12:22:32.473 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.432+0000 7f6b03fff700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6adc080630 0x7f6adc082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.473 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.432+0000 7f6b03fff700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6adc080630 0x7f6adc082af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6af40055a0 tx=0x7f6af4009040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.473 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.433+0000 7f6ae3fff700 1 -- 172.21.15.160:0/1576807324 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6af8078b80 con 0x7f6b04063490 2020-11-20T12:22:32.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.619+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b04044f60 con 0x7f6adc080630 2020-11-20T12:22:32.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.620+0000 7f6ae3fff700 1 -- 172.21.15.160:0/1576807324 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b04044f60 con 0x7f6adc080630 2020-11-20T12:22:32.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6adc080630 msgr2=0x7f6adc082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6adc080630 0x7f6adc082af0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f6af40055a0 tx=0x7f6af4009040).stop 2020-11-20T12:22:32.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 msgr2=0x7f6b0414d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b0414d140 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f6af8009fd0 tx=0x7f6af8015000).stop 2020-11-20T12:22:32.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 shutdown_connections 2020-11-20T12:22:32.631 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f6adc080630 0x7f6adc082af0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b0414fc90 0x7f6b04111bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b040630b0 0x7f6b04163ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 --2- 172.21.15.160:0/1576807324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b04063490 0x7f6b0414d140 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.622+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 >> 172.21.15.160:0/1576807324 conn(0x7f6b04060140 msgr2=0x7f6b04154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:32.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.623+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 shutdown_connections 2020-11-20T12:22:32.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.623+0000 7f6b09354700 1 -- 172.21.15.160:0/1576807324 wait complete. 2020-11-20T12:22:32.633 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 7 to deep-scrub 2020-11-20T12:22:32.646 INFO:tasks.ceph:Scrubbing osd.10 2020-11-20T12:22:32.647 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:32.877 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.873+0000 7ff5b5c76700 1 Processor -- start 2020-11-20T12:22:32.879 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.873+0000 7ff5b5c76700 1 -- start start 2020-11-20T12:22:32.885 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.874+0000 7ff5b5c76700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7ff5b00c0bd0 0x7ff5b0060140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.874+0000 7ff5b5c76700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b0151c40 con 0x7ff5b01543b0 2020-11-20T12:22:32.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.874+0000 7ff5b5c76700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b01519a0 con 0x7ff5b00be290 2020-11-20T12:22:32.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.874+0000 7ff5b5c76700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00998e0 con 0x7ff5b00c0bd0 2020-11-20T12:22:32.886 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5b4c74700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7ff5b01543b0 0x7ff5b0154790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47672/0 (socket says 172.21.15.160:47672) 2020-11-20T12:22:32.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5b4c74700 1 -- 172.21.15.160:0/1183062505 learned_addr learned my addr 172.21.15.160:0/1183062505 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:32.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5affff700 1 --2- 172.21.15.160:0/1183062505 >> v2:172.21.15.160:3300/0 conn(0x7ff5b00c0bd0 0x7ff5b0060140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5af7fe700 1 -- 172.21.15.160:0/1183062505 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520717358 0 0) 0x7ff5b0151c40 con 0x7ff5b01543b0 2020-11-20T12:22:32.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5af7fe700 1 -- 172.21.15.160:0/1183062505 --> v1:172.21.15.150:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff594003240 con 0x7ff5b01543b0 2020-11-20T12:22:32.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5af7fe700 1 -- 172.21.15.160:0/1183062505 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277108622 0 0) 0x7ff5b01519a0 con 0x7ff5b00be290 2020-11-20T12:22:32.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5affff700 1 -- 172.21.15.160:0/1183062505 >> v1:172.21.15.160:6789/0 conn(0x7ff5b00be290 legacy=0x7ff5b00be6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5affff700 1 -- 172.21.15.160:0/1183062505 >> v1:172.21.15.150:6789/0 conn(0x7ff5b01543b0 legacy=0x7ff5b0154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.875+0000 7ff5affff700 1 -- 172.21.15.160:0/1183062505 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0099ad0 con 0x7ff5b00c0bd0 2020-11-20T12:22:32.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.876+0000 7ff5affff700 1 --2- 172.21.15.160:0/1183062505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b00c0bd0 0x7ff5b0060140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff59c00b9a0 tx=0x7ff59c006df0).ready entity=mon.2 client_cookie=7798ce1643a2d8ed server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.876+0000 7ff5af7fe700 1 -- 172.21.15.160:0/1183062505 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c009770 con 0x7ff5b00c0bd0 2020-11-20T12:22:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.876+0000 7ff5af7fe700 1 -- 172.21.15.160:0/1183062505 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c0098d0 con 0x7ff5b00c0bd0 2020-11-20T12:22:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.876+0000 7ff5af7fe700 1 -- 172.21.15.160:0/1183062505 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c009c50 con 0x7ff5b00c0bd0 2020-11-20T12:22:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.876+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1183062505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b00c0bd0 msgr2=0x7ff5b0060140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.876+0000 7ff5b5c76700 1 --2- 172.21.15.160:0/1183062505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b00c0bd0 0x7ff5b0060140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff59c00b9a0 tx=0x7ff59c006df0).stop 2020-11-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.876+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1183062505 shutdown_connections 2020-11-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.877+0000 7ff5b5c76700 1 --2- 172.21.15.160:0/1183062505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b00c0bd0 0x7ff5b0060140 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.877+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1183062505 >> 172.21.15.160:0/1183062505 conn(0x7ff5b00c42e0 msgr2=0x7ff5b00c02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.877+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1183062505 shutdown_connections 2020-11-20T12:22:32.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.877+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1183062505 wait complete. 2020-11-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.878+0000 7ff5b5c76700 1 Processor -- start 2020-11-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.878+0000 7ff5b5c76700 1 -- start start 2020-11-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.879+0000 7ff5b5c76700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b00be290 0x7ff5b0160b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.879+0000 7ff5b5c76700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0bd0 0x7ff5b00bae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.879+0000 7ff5b5c76700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b01543b0 0x7ff5b00bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.879+0000 7ff5b5c76700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0161060 con 0x7ff5b00be290 2020-11-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.879+0000 7ff5b5c76700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0063280 con 0x7ff5b00c0bd0 2020-11-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.879+0000 7ff5b5c76700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0063520 con 0x7ff5b01543b0 2020-11-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b00be290 0x7ff5b0160b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b00be290 0x7ff5b0160b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33124/0 (socket says 172.21.15.160:33124) 2020-11-20T12:22:32.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 -- 172.21.15.160:0/1575729394 learned_addr learned my addr 172.21.15.160:0/1575729394 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:32.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b5475700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b01543b0 0x7ff5b00bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5affff700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0bd0 0x7ff5b00bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 -- 172.21.15.160:0/1575729394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b01543b0 msgr2=0x7ff5b00bbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.893 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5b01543b0 0x7ff5b00bbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 -- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0bd0 msgr2=0x7ff5b00bae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5b00c0bd0 0x7ff5b00bae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.880+0000 7ff5b4c74700 1 -- 172.21.15.160:0/1575729394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00637c0 con 0x7ff5b00be290 2020-11-20T12:22:32.894 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.881+0000 7ff5b4c74700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b00be290 0x7ff5b0160b70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff5a400c720 tx=0x7ff5a4007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.881+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40072e0 con 0x7ff5b00be290 2020-11-20T12:22:32.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.881+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4007440 con 0x7ff5b00be290 2020-11-20T12:22:32.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.881+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b0063a60 con 0x7ff5b00be290 2020-11-20T12:22:32.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.881+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4005800 con 0x7ff5b00be290 2020-11-20T12:22:32.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.881+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b00bb8f0 con 0x7ff5b00be290 2020-11-20T12:22:32.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.882+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5b0154ee0 con 0x7ff5b00be290 2020-11-20T12:22:32.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.884+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff5a4010070 con 0x7ff5b00be290 2020-11-20T12:22:32.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.885+0000 7ff5acff9700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff588080630 0x7ff588082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.885+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7ff5a40a2780 con 0x7ff5b00be290 2020-11-20T12:22:32.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.885+0000 7ff5acff9700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7ff588088cd0 0x7ff58808b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:32.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.885+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 --> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff58808b750 con 0x7ff588088cd0 2020-11-20T12:22:32.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.885+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5a40a2b80 con 0x7ff5b00be290 2020-11-20T12:22:32.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.885+0000 7ff5affff700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff588080630 0x7ff588082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.886+0000 7ff5b5475700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7ff588088cd0 0x7ff58808b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:32.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.886+0000 7ff5affff700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff588080630 0x7ff588082af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff59c00b150 tx=0x7ff59c015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.887+0000 7ff5b5475700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7ff588088cd0 0x7ff58808b0f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:32.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.887+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== osd.10 v2:172.21.15.150:6810/21743 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7ff58808b750 con 0x7ff588088cd0 2020-11-20T12:22:32.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.902+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 --> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5b0069460 con 0x7ff588088cd0 2020-11-20T12:22:32.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.903+0000 7ff5acff9700 1 -- 172.21.15.160:0/1575729394 <== osd.10 v2:172.21.15.150:6810/21743 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5b0069460 con 0x7ff588088cd0 2020-11-20T12:22:32.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.903+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7ff588088cd0 msgr2=0x7ff58808b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.903+0000 7ff5b5c76700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6810/21743,v1:172.21.15.150:6811/21743] conn(0x7ff588088cd0 0x7ff58808b0f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:32.908 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff588080630 msgr2=0x7ff588082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7ff588080630 0x7ff588082af0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff59c00b150 tx=0x7ff59c015000).stop 2020-11-20T12:22:32.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b00be290 msgr2=0x7ff5b0160b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:32.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 --2- 172.21.15.160:0/1575729394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5b00be290 0x7ff5b0160b70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7ff5a400c720 tx=0x7ff5a4007ac0).stop 2020-11-20T12:22:32.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5475700 1 -- 172.21.15.160:0/1575729394 reap_dead start 2020-11-20T12:22:32.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 shutdown_connections 2020-11-20T12:22:32.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 >> 172.21.15.160:0/1575729394 conn(0x7ff5b00c42e0 msgr2=0x7ff5b014d840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:32.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 shutdown_connections 2020-11-20T12:22:32.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:32.904+0000 7ff5b5c76700 1 -- 172.21.15.160:0/1575729394 wait complete. 2020-11-20T12:22:32.911 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:32.911 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:32.912 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:32.928 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2020-11-20T12:22:33.149 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.146+0000 7fb824a11700 1 Processor -- start 2020-11-20T12:22:33.150 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.146+0000 7fb824a11700 1 -- start start 2020-11-20T12:22:33.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb824a11700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb8200630b0 0x7fb820063490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb824a11700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8200c24d0 0x7fb8200c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb824a11700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8200c3a80 con 0x7fb820154230 2020-11-20T12:22:33.151 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb824a11700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8200c4c30 con 0x7fb8200c24d0 2020-11-20T12:22:33.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb824a11700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8200c3d10 con 0x7fb8200630b0 2020-11-20T12:22:33.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb81f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fb8200630b0 0x7fb820063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.166 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb81effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8200c24d0 0x7fb8200c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb81ffff700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fb820154230 0x7fb8201546a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47692/0 (socket says 172.21.15.160:47692) 2020-11-20T12:22:33.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb81effd700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fb8200c24d0 0x7fb8200c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51982/0 (socket says 172.21.15.160:51982) 2020-11-20T12:22:33.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.148+0000 7fb81ffff700 1 -- 172.21.15.160:0/979840783 learned_addr learned my addr 172.21.15.160:0/979840783 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:33.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81effd700 1 -- 172.21.15.160:0/979840783 >> v2:172.21.15.160:3300/0 conn(0x7fb8200630b0 msgr2=0x7fb820063490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:33.167 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81effd700 1 --2- 172.21.15.160:0/979840783 >> v2:172.21.15.160:3300/0 conn(0x7fb8200630b0 0x7fb820063490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81effd700 1 -- 172.21.15.160:0/979840783 >> v1:172.21.15.150:6789/0 conn(0x7fb820154230 legacy=0x7fb8201546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81effd700 1 -- 172.21.15.160:0/979840783 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200c3fb0 con 0x7fb8200c24d0 2020-11-20T12:22:33.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81e7fc700 1 -- 172.21.15.160:0/979840783 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501370779 0 0) 0x7fb8200c3a80 con 0x7fb820154230 2020-11-20T12:22:33.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81effd700 1 --2- 172.21.15.160:0/979840783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c24d0 0x7fb8200c2950 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb8200c8370 tx=0x7fb814006df0).ready entity=mon.1 client_cookie=30b29261f4872b94 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.168 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81e7fc700 1 -- 172.21.15.160:0/979840783 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814009840 con 0x7fb8200c24d0 2020-11-20T12:22:33.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81e7fc700 1 -- 172.21.15.160:0/979840783 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8140099a0 con 0x7fb8200c24d0 2020-11-20T12:22:33.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.149+0000 7fb81e7fc700 1 -- 172.21.15.160:0/979840783 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814009d20 con 0x7fb8200c24d0 2020-11-20T12:22:33.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 -- 172.21.15.160:0/979840783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c24d0 msgr2=0x7fb8200c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.169 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 --2- 172.21.15.160:0/979840783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c24d0 0x7fb8200c2950 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb8200c8370 tx=0x7fb814006df0).stop 2020-11-20T12:22:33.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 -- 172.21.15.160:0/979840783 shutdown_connections 2020-11-20T12:22:33.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 --2- 172.21.15.160:0/979840783 >> v2:172.21.15.160:3300/0 conn(0x7fb8200630b0 0x7fb820063490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 --2- 172.21.15.160:0/979840783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200c24d0 0x7fb8200c2950 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 -- 172.21.15.160:0/979840783 >> 172.21.15.160:0/979840783 conn(0x7fb820060140 msgr2=0x7fb820060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:33.170 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 -- 172.21.15.160:0/979840783 shutdown_connections 2020-11-20T12:22:33.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.150+0000 7fb824a11700 1 -- 172.21.15.160:0/979840783 wait complete. 2020-11-20T12:22:33.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.152+0000 7fb824a11700 1 Processor -- start 2020-11-20T12:22:33.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.152+0000 7fb824a11700 1 -- start start 2020-11-20T12:22:33.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb824a11700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200630b0 0x7fb82015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.171 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb824a11700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8200c24d0 0x7fb820163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb824a11700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb820154230 0x7fb820155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb824a11700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201634e0 con 0x7fb8200c24d0 2020-11-20T12:22:33.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb824a11700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb820160470 con 0x7fb8200630b0 2020-11-20T12:22:33.172 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb824a11700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb820156500 con 0x7fb820154230 2020-11-20T12:22:33.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb81f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200630b0 0x7fb82015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb81ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb820154230 0x7fb820155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb81f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200630b0 0x7fb82015ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:51986/0 (socket says 172.21.15.160:51986) 2020-11-20T12:22:33.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb81f7fe700 1 -- 172.21.15.160:0/1681357973 learned_addr learned my addr 172.21.15.160:0/1681357973 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:33.173 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.153+0000 7fb81effd700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8200c24d0 0x7fb820163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb81ffff700 1 -- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200630b0 msgr2=0x7fb82015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb81ffff700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200630b0 0x7fb82015ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb81ffff700 1 -- 172.21.15.160:0/1681357973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8200c24d0 msgr2=0x7fb820163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb81ffff700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8200c24d0 0x7fb820163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.174 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb81ffff700 1 -- 172.21.15.160:0/1681357973 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8201567a0 con 0x7fb820154230 2020-11-20T12:22:33.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb81f7fe700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200630b0 0x7fb82015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:33.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb81ffff700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb820154230 0x7fb820155d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb81800c880 tx=0x7fb818007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb7ff7fe700 1 -- 172.21.15.160:0/1681357973 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818005b80 con 0x7fb820154230 2020-11-20T12:22:33.175 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb7ff7fe700 1 -- 172.21.15.160:0/1681357973 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb818005ce0 con 0x7fb820154230 2020-11-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb820156a40 con 0x7fb820154230 2020-11-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb7ff7fe700 1 -- 172.21.15.160:0/1681357973 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818007340 con 0x7fb820154230 2020-11-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.154+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8201639b0 con 0x7fb820154230 2020-11-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.155+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb820044f60 con 0x7fb820154230 2020-11-20T12:22:33.176 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.157+0000 7fb7ff7fe700 1 -- 172.21.15.160:0/1681357973 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb818010030 con 0x7fb820154230 2020-11-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.158+0000 7fb7ff7fe700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb7f8080630 0x7fb7f8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.158+0000 7fb7ff7fe700 1 -- 172.21.15.160:0/1681357973 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fb8180a2990 con 0x7fb820154230 2020-11-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.158+0000 7fb81f7fe700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb7f8080630 0x7fb7f8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.158+0000 7fb81f7fe700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb7f8080630 0x7fb7f8082af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb810006a90 tx=0x7fb810006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.177 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.160+0000 7fb7ff7fe700 1 -- 172.21.15.160:0/1681357973 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb818077590 con 0x7fb820154230 2020-11-20T12:22:33.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.352+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) v1 -- 0x7fb820163bb0 con 0x7fb7f8080630 2020-11-20T12:22:33.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.353+0000 7fb7ff7fe700 1 -- 172.21.15.160:0/1681357973 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7fb81000bd50 con 0x7fb7f8080630 2020-11-20T12:22:33.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb7f8080630 msgr2=0x7fb7f8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb7f8080630 0x7fb7f8082af0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fb810006a90 tx=0x7fb810006df0).stop 2020-11-20T12:22:33.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb820154230 msgr2=0x7fb820155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb820154230 0x7fb820155d20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb81800c880 tx=0x7fb818007f10).stop 2020-11-20T12:22:33.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 shutdown_connections 2020-11-20T12:22:33.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb7f8080630 0x7fb7f8082af0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb820154230 0x7fb820155d20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb8200630b0 0x7fb82015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 --2- 172.21.15.160:0/1681357973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8200c24d0 0x7fb820163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 >> 172.21.15.160:0/1681357973 conn(0x7fb820060140 msgr2=0x7fb8200637d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:33.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 shutdown_connections 2020-11-20T12:22:33.361 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.355+0000 7fb824a11700 1 -- 172.21.15.160:0/1681357973 wait complete. 2020-11-20T12:22:33.361 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 10 to deep-scrub 2020-11-20T12:22:33.380 INFO:tasks.ceph:Scrubbing osd.2 2020-11-20T12:22:33.381 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:33.622 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.619+0000 7fdf6f59e700 1 Processor -- start 2020-11-20T12:22:33.623 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.619+0000 7fdf6f59e700 1 -- start start 2020-11-20T12:22:33.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.621+0000 7fdf6f59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdf700c3e30 0x7fdf700c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.621+0000 7fdf6f59e700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf70064e10 con 0x7fdf700c4210 2020-11-20T12:22:33.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.621+0000 7fdf6f59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700c4660 con 0x7fdf700627c0 2020-11-20T12:22:33.624 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.621+0000 7fdf6f59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf70065e90 con 0x7fdf700c3e30 2020-11-20T12:22:33.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.621+0000 7fdf6e59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fdf700c3e30 0x7fdf700c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.626 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.621+0000 7fdf6dd9b700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7fdf700627c0 0x7fdf70150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56440/0 (socket says 172.21.15.160:56440) 2020-11-20T12:22:33.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.621+0000 7fdf6dd9b700 1 -- 172.21.15.160:0/675528104 learned_addr learned my addr 172.21.15.160:0/675528104 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:33.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6d59a700 1 -- 172.21.15.160:0/675528104 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639238711 0 0) 0x7fdf70064e10 con 0x7fdf700c4210 2020-11-20T12:22:33.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6d59a700 1 -- 172.21.15.160:0/675528104 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf54003240 con 0x7fdf700c4210 2020-11-20T12:22:33.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6d59a700 1 -- 172.21.15.160:0/675528104 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496497217 0 0) 0x7fdf700c4660 con 0x7fdf700627c0 2020-11-20T12:22:33.627 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6e59c700 1 -- 172.21.15.160:0/675528104 >> v1:172.21.15.160:6789/0 conn(0x7fdf700627c0 legacy=0x7fdf70150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6e59c700 1 -- 172.21.15.160:0/675528104 >> v1:172.21.15.134:6789/0 conn(0x7fdf700c4210 legacy=0x7fdf70065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6e59c700 1 -- 172.21.15.160:0/675528104 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70151540 con 0x7fdf700c3e30 2020-11-20T12:22:33.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6e59c700 1 --2- 172.21.15.160:0/675528104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 0x7fdf700c1d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdf6000b9a0 tx=0x7fdf60006df0).ready entity=mon.2 client_cookie=77678c2780a87ca4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6d59a700 1 -- 172.21.15.160:0/675528104 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf600097b0 con 0x7fdf700c3e30 2020-11-20T12:22:33.628 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6d59a700 1 -- 172.21.15.160:0/675528104 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf60009910 con 0x7fdf700c3e30 2020-11-20T12:22:33.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.622+0000 7fdf6d59a700 1 -- 172.21.15.160:0/675528104 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60009c90 con 0x7fdf700c3e30 2020-11-20T12:22:33.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.623+0000 7fdf6f59e700 1 -- 172.21.15.160:0/675528104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 msgr2=0x7fdf700c1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.623+0000 7fdf6f59e700 1 --2- 172.21.15.160:0/675528104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 0x7fdf700c1d30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fdf6000b9a0 tx=0x7fdf60006df0).stop 2020-11-20T12:22:33.629 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.623+0000 7fdf6f59e700 1 -- 172.21.15.160:0/675528104 shutdown_connections 2020-11-20T12:22:33.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.623+0000 7fdf6f59e700 1 --2- 172.21.15.160:0/675528104 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 0x7fdf700c1d30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.623+0000 7fdf6f59e700 1 -- 172.21.15.160:0/675528104 >> 172.21.15.160:0/675528104 conn(0x7fdf70062ed0 msgr2=0x7fdf700632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:33.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.623+0000 7fdf6f59e700 1 -- 172.21.15.160:0/675528104 shutdown_connections 2020-11-20T12:22:33.630 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.623+0000 7fdf6f59e700 1 -- 172.21.15.160:0/675528104 wait complete. 2020-11-20T12:22:33.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.625+0000 7fdf6f59e700 1 Processor -- start 2020-11-20T12:22:33.632 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.625+0000 7fdf6f59e700 1 -- start start 2020-11-20T12:22:33.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf700627c0 0x7fdf70112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6f59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 0x7fdf701606a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6f59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf700c4210 0x7fdf700c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.633 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6f59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70112d00 con 0x7fdf700c4210 2020-11-20T12:22:33.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700bf560 con 0x7fdf700627c0 2020-11-20T12:22:33.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6f59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700bf800 con 0x7fdf700c3e30 2020-11-20T12:22:33.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf700627c0 0x7fdf70112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.626+0000 7fdf6dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 0x7fdf701606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.634 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6e59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf700627c0 0x7fdf70112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52000/0 (socket says 172.21.15.160:52000) 2020-11-20T12:22:33.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6e59c700 1 -- 172.21.15.160:0/3976819162 learned_addr learned my addr 172.21.15.160:0/3976819162 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:33.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6ed9d700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf700c4210 0x7fdf700c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6dd9b700 1 -- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf700627c0 msgr2=0x7fdf70112640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6dd9b700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf700627c0 0x7fdf70112640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.635 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6dd9b700 1 -- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf700c4210 msgr2=0x7fdf700c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6dd9b700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf700c4210 0x7fdf700c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6dd9b700 1 -- 172.21.15.160:0/3976819162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf700bfaa0 con 0x7fdf700c3e30 2020-11-20T12:22:33.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6e59c700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdf700627c0 0x7fdf70112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:33.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6ed9d700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdf700c4210 0x7fdf700c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:33.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.627+0000 7fdf6dd9b700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 0x7fdf701606a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fdf6400c710 tx=0x7fdf640079c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.636 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.628+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640072e0 con 0x7fdf700c3e30 2020-11-20T12:22:33.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.628+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf64007440 con 0x7fdf700c3e30 2020-11-20T12:22:33.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.628+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf700bfd40 con 0x7fdf700c3e30 2020-11-20T12:22:33.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.628+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64005800 con 0x7fdf700c3e30 2020-11-20T12:22:33.637 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.628+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf700c01e0 con 0x7fdf700c3e30 2020-11-20T12:22:33.638 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.629+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf70069460 con 0x7fdf700c3e30 2020-11-20T12:22:33.639 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.630+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fdf64010070 con 0x7fdf700c3e30 2020-11-20T12:22:33.639 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.631+0000 7fdf5e7fc700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fdf44080630 0x7fdf44082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.639 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.631+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fdf640a24b0 con 0x7fdf700c3e30 2020-11-20T12:22:33.639 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.631+0000 7fdf5e7fc700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7fdf44088c50 0x7fdf4408b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.631+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 --> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf4408b6d0 con 0x7fdf44088c50 2020-11-20T12:22:33.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.631+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf640a28b0 con 0x7fdf700c3e30 2020-11-20T12:22:33.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.631+0000 7fdf6e59c700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fdf44080630 0x7fdf44082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.632+0000 7fdf6ed9d700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7fdf44088c50 0x7fdf4408b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.640 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.632+0000 7fdf6e59c700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fdf44080630 0x7fdf44082af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fdf6000c010 tx=0x7fdf60015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.632+0000 7fdf6ed9d700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7fdf44088c50 0x7fdf4408b070 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.641 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.633+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== osd.2 v2:172.21.15.134:6800/22183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fdf4408b6d0 con 0x7fdf44088c50 2020-11-20T12:22:33.651 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.648+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 --> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdf700bfed0 con 0x7fdf44088c50 2020-11-20T12:22:33.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.648+0000 7fdf5e7fc700 1 -- 172.21.15.160:0/3976819162 <== osd.2 v2:172.21.15.134:6800/22183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdf700bfed0 con 0x7fdf44088c50 2020-11-20T12:22:33.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7fdf44088c50 msgr2=0x7fdf4408b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.134:6800/22183,v1:172.21.15.134:6801/22183] conn(0x7fdf44088c50 0x7fdf4408b070 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fdf44080630 msgr2=0x7fdf44082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fdf44080630 0x7fdf44082af0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fdf6000c010 tx=0x7fdf60015000).stop 2020-11-20T12:22:33.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 msgr2=0x7fdf701606a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 --2- 172.21.15.160:0/3976819162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf700c3e30 0x7fdf701606a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fdf6400c710 tx=0x7fdf640079c0).stop 2020-11-20T12:22:33.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6ed9d700 1 -- 172.21.15.160:0/3976819162 reap_dead start 2020-11-20T12:22:33.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 shutdown_connections 2020-11-20T12:22:33.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 >> 172.21.15.160:0/3976819162 conn(0x7fdf70062ed0 msgr2=0x7fdf700c6020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:33.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 shutdown_connections 2020-11-20T12:22:33.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.649+0000 7fdf6f59e700 1 -- 172.21.15.160:0/3976819162 wait complete. 2020-11-20T12:22:33.655 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:33.655 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:33.655 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:33.671 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2020-11-20T12:22:33.884 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.881+0000 7f13362e6700 1 Processor -- start 2020-11-20T12:22:33.884 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.881+0000 7f13362e6700 1 -- start start 2020-11-20T12:22:33.887 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13362e6700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f13300630b0 0x7f1330063490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13362e6700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f13300c24d0 0x7f13300c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13362e6700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13300c3a80 con 0x7f1330154230 2020-11-20T12:22:33.888 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13362e6700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13300c4c30 con 0x7f13300c24d0 2020-11-20T12:22:33.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13362e6700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13300c3d10 con 0x7f13300630b0 2020-11-20T12:22:33.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13352e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f13300630b0 0x7f1330063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13352e4700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f13300630b0 0x7f1330063490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52010/0 (socket says 172.21.15.160:52010) 2020-11-20T12:22:33.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f13352e4700 1 -- 172.21.15.160:0/1251757998 learned_addr learned my addr 172.21.15.160:0/1251757998 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:33.889 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.883+0000 7f1334ae3700 1 --2- 172.21.15.160:0/1251757998 >> v2:172.21.15.134:3300/0 conn(0x7f13300c24d0 0x7f13300c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f131ffff700 1 -- 172.21.15.160:0/1251757998 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017467071 0 0) 0x7f13300c3a80 con 0x7f1330154230 2020-11-20T12:22:33.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f131ffff700 1 -- 172.21.15.160:0/1251757998 --> v1:172.21.15.134:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1318003240 con 0x7f1330154230 2020-11-20T12:22:33.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f13352e4700 1 -- 172.21.15.160:0/1251757998 >> v2:172.21.15.134:3300/0 conn(0x7f13300c24d0 msgr2=0x7f13300c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:33.890 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f13352e4700 1 --2- 172.21.15.160:0/1251757998 >> v2:172.21.15.134:3300/0 conn(0x7f13300c24d0 0x7f13300c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f13352e4700 1 -- 172.21.15.160:0/1251757998 >> v1:172.21.15.134:6789/0 conn(0x7f1330154230 legacy=0x7f13301546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f13352e4700 1 -- 172.21.15.160:0/1251757998 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300c3fb0 con 0x7f13300630b0 2020-11-20T12:22:33.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f1334ae3700 1 --2- 172.21.15.160:0/1251757998 >> v2:172.21.15.134:3300/0 conn(0x7f13300c24d0 0x7f13300c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:33.891 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f13352e4700 1 --2- 172.21.15.160:0/1251757998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300630b0 0x7f1330063490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f13300c8370 tx=0x7f132c006eb0).ready entity=mon.1 client_cookie=dc4be917863bd9c0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f131ffff700 1 -- 172.21.15.160:0/1251757998 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0097b0 con 0x7f13300630b0 2020-11-20T12:22:33.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f131ffff700 1 -- 172.21.15.160:0/1251757998 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c009910 con 0x7f13300630b0 2020-11-20T12:22:33.892 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.884+0000 7f131ffff700 1 -- 172.21.15.160:0/1251757998 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c009c90 con 0x7f13300630b0 2020-11-20T12:22:33.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 -- 172.21.15.160:0/1251757998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300630b0 msgr2=0x7f1330063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.895 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 --2- 172.21.15.160:0/1251757998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300630b0 0x7f1330063490 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f13300c8370 tx=0x7f132c006eb0).stop 2020-11-20T12:22:33.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 -- 172.21.15.160:0/1251757998 shutdown_connections 2020-11-20T12:22:33.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 --2- 172.21.15.160:0/1251757998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300630b0 0x7f1330063490 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.896 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 --2- 172.21.15.160:0/1251757998 >> v2:172.21.15.134:3300/0 conn(0x7f13300c24d0 0x7f13300c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 -- 172.21.15.160:0/1251757998 >> 172.21.15.160:0/1251757998 conn(0x7f1330060140 msgr2=0x7f1330060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:33.897 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 -- 172.21.15.160:0/1251757998 shutdown_connections 2020-11-20T12:22:33.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.885+0000 7f13362e6700 1 -- 172.21.15.160:0/1251757998 wait complete. 2020-11-20T12:22:33.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.887+0000 7f13362e6700 1 Processor -- start 2020-11-20T12:22:33.898 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.887+0000 7f13362e6700 1 -- start start 2020-11-20T12:22:33.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f13362e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13300630b0 0x7f13301124a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f13362e6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300c24d0 0x7f1330111cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.899 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f13362e6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1330154230 0x7f13301536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f13362e6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330153be0 con 0x7f13300630b0 2020-11-20T12:22:33.900 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f13362e6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330114ff0 con 0x7f13300c24d0 2020-11-20T12:22:33.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f13362e6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330115290 con 0x7f1330154230 2020-11-20T12:22:33.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f1334ae3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300c24d0 0x7f1330111cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.901 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f1334ae3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300c24d0 0x7f1330111cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52018/0 (socket says 172.21.15.160:52018) 2020-11-20T12:22:33.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f1334ae3700 1 -- 172.21.15.160:0/2524099180 learned_addr learned my addr 172.21.15.160:0/2524099180 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:33.902 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f13352e4700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13300630b0 0x7f13301124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.888+0000 7f1335ae5700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1330154230 0x7f13301536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13352e4700 1 -- 172.21.15.160:0/2524099180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1330154230 msgr2=0x7f13301536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.903 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13352e4700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1330154230 0x7f13301536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13352e4700 1 -- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300c24d0 msgr2=0x7f1330111cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:33.904 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13352e4700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300c24d0 0x7f1330111cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:33.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13352e4700 1 -- 172.21.15.160:0/2524099180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330115530 con 0x7f13300630b0 2020-11-20T12:22:33.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13352e4700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13300630b0 0x7f13301124a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f132c012000 tx=0x7f132c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.905 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f131d7fa700 1 -- 172.21.15.160:0/2524099180 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c011d50 con 0x7f13300630b0 2020-11-20T12:22:33.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f131d7fa700 1 -- 172.21.15.160:0/2524099180 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c01e460 con 0x7f13300630b0 2020-11-20T12:22:33.906 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1330064a00 con 0x7f13300630b0 2020-11-20T12:22:33.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f131d7fa700 1 -- 172.21.15.160:0/2524099180 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c01e800 con 0x7f13300630b0 2020-11-20T12:22:33.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.889+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1330114ce0 con 0x7f13300630b0 2020-11-20T12:22:33.907 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.890+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1330064e60 con 0x7f13300630b0 2020-11-20T12:22:33.909 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.893+0000 7f131d7fa700 1 -- 172.21.15.160:0/2524099180 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f132c025030 con 0x7f13300630b0 2020-11-20T12:22:33.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.893+0000 7f131d7fa700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1308080630 0x7f1308082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:33.910 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.894+0000 7f131d7fa700 1 -- 172.21.15.160:0/2524099180 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f132c0a4040 con 0x7f13300630b0 2020-11-20T12:22:33.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.894+0000 7f1334ae3700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1308080630 0x7f1308082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:33.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.894+0000 7f1334ae3700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1308080630 0x7f1308082af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1330065f40 tx=0x7f1320006df0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:33.911 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:33.895+0000 7f131d7fa700 1 -- 172.21.15.160:0/2524099180 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f132c078c40 con 0x7f13300630b0 2020-11-20T12:22:34.084 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.081+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1330044f60 con 0x7f1308080630 2020-11-20T12:22:34.085 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.082+0000 7f131d7fa700 1 -- 172.21.15.160:0/2524099180 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1330044f60 con 0x7f1308080630 2020-11-20T12:22:34.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1308080630 msgr2=0x7f1308082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.087 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1308080630 0x7f1308082af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1330065f40 tx=0x7f1320006df0).stop 2020-11-20T12:22:34.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13300630b0 msgr2=0x7f13301124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13300630b0 0x7f13301124a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f132c012000 tx=0x7f132c015000).stop 2020-11-20T12:22:34.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 shutdown_connections 2020-11-20T12:22:34.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f1308080630 0x7f1308082af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.088 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1330154230 0x7f13301536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13300630b0 0x7f13301124a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 --2- 172.21.15.160:0/2524099180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13300c24d0 0x7f1330111cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 >> 172.21.15.160:0/2524099180 conn(0x7f1330060140 msgr2=0x7f1330151d90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 shutdown_connections 2020-11-20T12:22:34.089 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.084+0000 7f13362e6700 1 -- 172.21.15.160:0/2524099180 wait complete. 2020-11-20T12:22:34.090 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 2 to deep-scrub 2020-11-20T12:22:34.108 INFO:tasks.ceph:Scrubbing osd.5 2020-11-20T12:22:34.109 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:34.321 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.318+0000 7fb7624fd700 1 Processor -- start 2020-11-20T12:22:34.322 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.319+0000 7fb7624fd700 1 -- start start 2020-11-20T12:22:34.323 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.320+0000 7fb7624fd700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fb75c0627c0 0x7fb75c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.320+0000 7fb7624fd700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c064e10 con 0x7fb75c0c3e30 2020-11-20T12:22:34.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.320+0000 7fb7624fd700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c065e90 con 0x7fb75c0c1d30 2020-11-20T12:22:34.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.320+0000 7fb7624fd700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c062c10 con 0x7fb75c0627c0 2020-11-20T12:22:34.324 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb7614fb700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fb75c0c3e30 0x7fb75c150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:32964/0 (socket says 172.21.15.160:32964) 2020-11-20T12:22:34.325 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb7614fb700 1 -- 172.21.15.160:0/1370388873 learned_addr learned my addr 172.21.15.160:0/1370388873 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:34.325 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb761cfc700 1 --2- 172.21.15.160:0/1370388873 >> v2:172.21.15.134:3300/0 conn(0x7fb75c0627c0 0x7fb75c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.326 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb761cfc700 1 -- 172.21.15.160:0/1370388873 >> v1:172.21.15.150:6789/0 conn(0x7fb75c0c1d30 legacy=0x7fb75c065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.326 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb761cfc700 1 -- 172.21.15.160:0/1370388873 >> v1:172.21.15.134:6789/0 conn(0x7fb75c0c3e30 legacy=0x7fb75c150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb761cfc700 1 -- 172.21.15.160:0/1370388873 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c151540 con 0x7fb75c0627c0 2020-11-20T12:22:34.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb74bfff700 1 -- 172.21.15.160:0/1370388873 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184157984 0 0) 0x7fb75c064e10 con 0x7fb75c0c3e30 2020-11-20T12:22:34.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.321+0000 7fb761cfc700 1 --2- 172.21.15.160:0/1370388873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 0x7fb75c0c4210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb754009c90 tx=0x7fb7540091d0).ready entity=mon.0 client_cookie=a5ac9433b3bbe884 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:34.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb74bfff700 1 -- 172.21.15.160:0/1370388873 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400bbc0 con 0x7fb75c0627c0 2020-11-20T12:22:34.327 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb74bfff700 1 -- 172.21.15.160:0/1370388873 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400bd20 con 0x7fb75c0627c0 2020-11-20T12:22:34.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb74bfff700 1 -- 172.21.15.160:0/1370388873 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011610 con 0x7fb75c0627c0 2020-11-20T12:22:34.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb7624fd700 1 -- 172.21.15.160:0/1370388873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 msgr2=0x7fb75c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb7624fd700 1 --2- 172.21.15.160:0/1370388873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 0x7fb75c0c4210 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fb754009c90 tx=0x7fb7540091d0).stop 2020-11-20T12:22:34.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb7624fd700 1 -- 172.21.15.160:0/1370388873 shutdown_connections 2020-11-20T12:22:34.328 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb7624fd700 1 --2- 172.21.15.160:0/1370388873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 0x7fb75c0c4210 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.329 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb7624fd700 1 -- 172.21.15.160:0/1370388873 >> 172.21.15.160:0/1370388873 conn(0x7fb75c062ed0 msgr2=0x7fb75c0632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:34.329 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb7624fd700 1 -- 172.21.15.160:0/1370388873 shutdown_connections 2020-11-20T12:22:34.329 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.322+0000 7fb7624fd700 1 -- 172.21.15.160:0/1370388873 wait complete. 2020-11-20T12:22:34.331 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.324+0000 7fb7624fd700 1 Processor -- start 2020-11-20T12:22:34.331 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.324+0000 7fb7624fd700 1 -- start start 2020-11-20T12:22:34.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb7624fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 0x7fb75c160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb7624fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0c1d30 0x7fb75c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb7624fd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb75c0c3e30 0x7fb75c1631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.332 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb7624fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c1130b0 con 0x7fb75c0627c0 2020-11-20T12:22:34.333 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb7624fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c112b70 con 0x7fb75c0c1d30 2020-11-20T12:22:34.333 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb7624fd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c112e10 con 0x7fb75c0c3e30 2020-11-20T12:22:34.333 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb761cfc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb75c0c3e30 0x7fb75c1631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.333 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb7614fb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 0x7fb75c160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.333 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb761cfc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb75c0c3e30 0x7fb75c1631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38898/0 (socket says 172.21.15.160:38898) 2020-11-20T12:22:34.334 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb761cfc700 1 -- 172.21.15.160:0/2394885741 learned_addr learned my addr 172.21.15.160:0/2394885741 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:34.334 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.325+0000 7fb760cfa700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0c1d30 0x7fb75c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.334 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb7614fb700 1 -- 172.21.15.160:0/2394885741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb75c0c3e30 msgr2=0x7fb75c1631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.334 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb7614fb700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb75c0c3e30 0x7fb75c1631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.334 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb7614fb700 1 -- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0c1d30 msgr2=0x7fb75c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.335 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb7614fb700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb75c0c1d30 0x7fb75c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.335 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb7614fb700 1 -- 172.21.15.160:0/2394885741 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c15fe20 con 0x7fb75c0627c0 2020-11-20T12:22:34.335 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb7614fb700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 0x7fb75c160800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb75800c760 tx=0x7fb758007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:34.335 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.326+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580072e0 con 0x7fb75c0627c0 2020-11-20T12:22:34.335 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.327+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758007440 con 0x7fb75c0627c0 2020-11-20T12:22:34.336 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.327+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c1600c0 con 0x7fb75c0627c0 2020-11-20T12:22:34.336 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.327+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758005820 con 0x7fb75c0627c0 2020-11-20T12:22:34.336 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.327+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c1127c0 con 0x7fb75c0627c0 2020-11-20T12:22:34.336 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.327+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb75c069460 con 0x7fb75c0627c0 2020-11-20T12:22:34.337 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.329+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb75801a060 con 0x7fb75c0627c0 2020-11-20T12:22:34.338 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.330+0000 7fb7497fa700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb734080630 0x7fb734082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.338 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.330+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fb7580a21f0 con 0x7fb75c0627c0 2020-11-20T12:22:34.338 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.330+0000 7fb7497fa700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7fb734088cd0 0x7fb73408b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.338 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.330+0000 7fb760cfa700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb734080630 0x7fb734082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.339 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.330+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 --> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb73408b750 con 0x7fb734088cd0 2020-11-20T12:22:34.339 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.330+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7580a25f0 con 0x7fb75c0627c0 2020-11-20T12:22:34.339 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.331+0000 7fb761cfc700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7fb734088cd0 0x7fb73408b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.339 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.331+0000 7fb760cfa700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb734080630 0x7fb734082af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb75c1552a0 tx=0x7fb74c007b70).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:34.339 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.331+0000 7fb761cfc700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7fb734088cd0 0x7fb73408b0f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:34.340 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.332+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== osd.5 v2:172.21.15.134:6816/22195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7fb73408b750 con 0x7fb734088cd0 2020-11-20T12:22:34.349 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.347+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 --> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb75c160520 con 0x7fb734088cd0 2020-11-20T12:22:34.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.347+0000 7fb7497fa700 1 -- 172.21.15.160:0/2394885741 <== osd.5 v2:172.21.15.134:6816/22195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb75c160520 con 0x7fb734088cd0 2020-11-20T12:22:34.351 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:34.351 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:34.351 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:34.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7fb734088cd0 msgr2=0x7fb73408b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:6816/22195,v1:172.21.15.134:6817/22195] conn(0x7fb734088cd0 0x7fb73408b0f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb734080630 msgr2=0x7fb734082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fb734080630 0x7fb734082af0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb75c1552a0 tx=0x7fb74c007b70).stop 2020-11-20T12:22:34.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 msgr2=0x7fb75c160800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 --2- 172.21.15.160:0/2394885741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb75c0627c0 0x7fb75c160800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fb75800c760 tx=0x7fb758007c20).stop 2020-11-20T12:22:34.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb761cfc700 1 -- 172.21.15.160:0/2394885741 reap_dead start 2020-11-20T12:22:34.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 shutdown_connections 2020-11-20T12:22:34.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 >> 172.21.15.160:0/2394885741 conn(0x7fb75c062ed0 msgr2=0x7fb75c14c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:34.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 shutdown_connections 2020-11-20T12:22:34.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.348+0000 7fb7624fd700 1 -- 172.21.15.160:0/2394885741 wait complete. 2020-11-20T12:22:34.373 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2020-11-20T12:22:34.590 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.587+0000 7fc398f8b700 1 Processor -- start 2020-11-20T12:22:34.590 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.587+0000 7fc398f8b700 1 -- start start 2020-11-20T12:22:34.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.588+0000 7fc398f8b700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc394061870 0x7fc394061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc398f8b700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fc394151070 0x7fc3940bb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc398f8b700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7fc394064960 0x7fc394064df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.592 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc398f8b700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940652e0 con 0x7fc394064960 2020-11-20T12:22:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc398f8b700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3940bc0d0 con 0x7fc394061870 2020-11-20T12:22:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc398f8b700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39414d2b0 con 0x7fc394151070 2020-11-20T12:22:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc3937fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc394061870 0x7fc394061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.593 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc3937fe700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fc394061870 0x7fc394061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52040/0 (socket says 172.21.15.160:52040) 2020-11-20T12:22:34.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc3937fe700 1 -- 172.21.15.160:0/2278061442 learned_addr learned my addr 172.21.15.160:0/2278061442 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:34.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc392ffd700 1 --2- 172.21.15.160:0/2278061442 >> v2:172.21.15.160:3300/0 conn(0x7fc394151070 0x7fc3940bb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.594 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.589+0000 7fc393fff700 1 --2- 172.21.15.160:0/2278061442 >> v2:172.21.15.134:3300/0 conn(0x7fc394064960 0x7fc394064df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.595 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc393fff700 1 -- 172.21.15.160:0/2278061442 >> v2:172.21.15.160:3300/0 conn(0x7fc394151070 msgr2=0x7fc3940bb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:34.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc393fff700 1 --2- 172.21.15.160:0/2278061442 >> v2:172.21.15.160:3300/0 conn(0x7fc394151070 0x7fc3940bb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc393fff700 1 -- 172.21.15.160:0/2278061442 >> v2:172.21.15.150:3300/0 conn(0x7fc394061870 msgr2=0x7fc394061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:34.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc393fff700 1 --2- 172.21.15.160:0/2278061442 >> v2:172.21.15.150:3300/0 conn(0x7fc394061870 0x7fc394061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.596 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc393fff700 1 -- 172.21.15.160:0/2278061442 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39414d550 con 0x7fc394064960 2020-11-20T12:22:34.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc3937fe700 1 --2- 172.21.15.160:0/2278061442 >> v2:172.21.15.150:3300/0 conn(0x7fc394061870 0x7fc394061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:34.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc393fff700 1 --2- 172.21.15.160:0/2278061442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc394064df0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fc3940c3fa0 tx=0x7fc38c0091d0).ready entity=mon.0 client_cookie=608244970ec2c3e3 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:34.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.590+0000 7fc3927fc700 1 -- 172.21.15.160:0/2278061442 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00ba20 con 0x7fc394064960 2020-11-20T12:22:34.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc3927fc700 1 -- 172.21.15.160:0/2278061442 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c00bb80 con 0x7fc394064960 2020-11-20T12:22:34.597 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc3927fc700 1 -- 172.21.15.160:0/2278061442 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c011400 con 0x7fc394064960 2020-11-20T12:22:34.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 -- 172.21.15.160:0/2278061442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 msgr2=0x7fc394064df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 --2- 172.21.15.160:0/2278061442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc394064df0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fc3940c3fa0 tx=0x7fc38c0091d0).stop 2020-11-20T12:22:34.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 -- 172.21.15.160:0/2278061442 shutdown_connections 2020-11-20T12:22:34.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 --2- 172.21.15.160:0/2278061442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc394064df0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.598 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 --2- 172.21.15.160:0/2278061442 >> v2:172.21.15.150:3300/0 conn(0x7fc394061870 0x7fc394061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 --2- 172.21.15.160:0/2278061442 >> v2:172.21.15.160:3300/0 conn(0x7fc394151070 0x7fc3940bb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 -- 172.21.15.160:0/2278061442 >> 172.21.15.160:0/2278061442 conn(0x7fc394062ef0 msgr2=0x7fc394063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.591+0000 7fc398f8b700 1 -- 172.21.15.160:0/2278061442 shutdown_connections 2020-11-20T12:22:34.599 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.592+0000 7fc398f8b700 1 -- 172.21.15.160:0/2278061442 wait complete. 2020-11-20T12:22:34.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.593+0000 7fc398f8b700 1 Processor -- start 2020-11-20T12:22:34.601 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.593+0000 7fc398f8b700 1 -- start start 2020-11-20T12:22:34.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.594+0000 7fc398f8b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394061870 0x7fc39414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.594+0000 7fc398f8b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc3940bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.594+0000 7fc398f8b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc394151070 0x7fc394143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.594+0000 7fc398f8b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3941377e0 con 0x7fc394064960 2020-11-20T12:22:34.602 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.594+0000 7fc398f8b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39414f480 con 0x7fc394061870 2020-11-20T12:22:34.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.594+0000 7fc398f8b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39414e4c0 con 0x7fc394151070 2020-11-20T12:22:34.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc393fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc394151070 0x7fc394143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc392ffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc3940bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.603 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394061870 0x7fc39414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc393fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc394151070 0x7fc394143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38914/0 (socket says 172.21.15.160:38914) 2020-11-20T12:22:34.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc393fff700 1 -- 172.21.15.160:0/3282240143 learned_addr learned my addr 172.21.15.160:0/3282240143 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:34.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc392ffd700 1 -- 172.21.15.160:0/3282240143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc394151070 msgr2=0x7fc394143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc392ffd700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc394151070 0x7fc394143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.604 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc392ffd700 1 -- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394061870 msgr2=0x7fc39414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc392ffd700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394061870 0x7fc39414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc392ffd700 1 -- 172.21.15.160:0/3282240143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39414e760 con 0x7fc394064960 2020-11-20T12:22:34.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.595+0000 7fc392ffd700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc3940bdea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fc38800eba0 tx=0x7fc388006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:34.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.596+0000 7fc3737fe700 1 -- 172.21.15.160:0/3282240143 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800c850 con 0x7fc394064960 2020-11-20T12:22:34.605 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.596+0000 7fc3737fe700 1 -- 172.21.15.160:0/3282240143 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38800c9b0 con 0x7fc394064960 2020-11-20T12:22:34.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.596+0000 7fc3737fe700 1 -- 172.21.15.160:0/3282240143 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800cd30 con 0x7fc394064960 2020-11-20T12:22:34.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.596+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39414ea00 con 0x7fc394064960 2020-11-20T12:22:34.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.596+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39414ef40 con 0x7fc394064960 2020-11-20T12:22:34.606 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.597+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc394044f60 con 0x7fc394064960 2020-11-20T12:22:34.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.599+0000 7fc3737fe700 1 -- 172.21.15.160:0/3282240143 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc388012600 con 0x7fc394064960 2020-11-20T12:22:34.607 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.600+0000 7fc3737fe700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc36c080660 0x7fc36c082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:34.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.600+0000 7fc3737fe700 1 -- 172.21.15.160:0/3282240143 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fc3880a2f00 con 0x7fc394064960 2020-11-20T12:22:34.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.600+0000 7fc3937fe700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc36c080660 0x7fc36c082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:34.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.601+0000 7fc3937fe700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc36c080660 0x7fc36c082b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc384006fd0 tx=0x7fc384006eb0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:34.608 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.602+0000 7fc3737fe700 1 -- 172.21.15.160:0/3282240143 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc388077b00 con 0x7fc394064960 2020-11-20T12:22:34.796 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.793+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3940bdac0 con 0x7fc36c080660 2020-11-20T12:22:34.797 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.794+0000 7fc3737fe700 1 -- 172.21.15.160:0/3282240143 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3940bdac0 con 0x7fc36c080660 2020-11-20T12:22:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc36c080660 msgr2=0x7fc36c082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc36c080660 0x7fc36c082b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fc384006fd0 tx=0x7fc384006eb0).stop 2020-11-20T12:22:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 msgr2=0x7fc3940bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:34.799 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc3940bdea0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fc38800eba0 tx=0x7fc388006df0).stop 2020-11-20T12:22:34.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 shutdown_connections 2020-11-20T12:22:34.800 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fc36c080660 0x7fc36c082b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc394151070 0x7fc394143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc394061870 0x7fc39414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 --2- 172.21.15.160:0/3282240143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc394064960 0x7fc3940bdea0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 >> 172.21.15.160:0/3282240143 conn(0x7fc394062ef0 msgr2=0x7fc3940632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:34.801 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 shutdown_connections 2020-11-20T12:22:34.802 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:34.796+0000 7fc398f8b700 1 -- 172.21.15.160:0/3282240143 wait complete. 2020-11-20T12:22:34.802 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 5 to deep-scrub 2020-11-20T12:22:34.822 INFO:tasks.ceph:Scrubbing osd.8 2020-11-20T12:22:34.823 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:35.062 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.059+0000 7f0bdf59e700 1 Processor -- start 2020-11-20T12:22:35.062 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.059+0000 7f0bdf59e700 1 -- start start 2020-11-20T12:22:35.064 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bdf59e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0be00c1d30 0x7f0be00627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.064 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bdf59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0be00c4210 0x7f0be0065780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.064 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bdf59e700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be0064e10 con 0x7f0be00c3e30 2020-11-20T12:22:35.064 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bdf59e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be00c4660 con 0x7f0be00c1d30 2020-11-20T12:22:35.065 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bdf59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be0151540 con 0x7f0be00c4210 2020-11-20T12:22:35.067 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bde59c700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f0be00c3e30 0x7f0be0150cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56498/0 (socket says 172.21.15.160:56498) 2020-11-20T12:22:35.067 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bde59c700 1 -- 172.21.15.160:0/111765479 learned_addr learned my addr 172.21.15.160:0/111765479 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:35.067 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bddd9b700 1 --2- 172.21.15.160:0/111765479 >> v2:172.21.15.134:3300/0 conn(0x7f0be00c1d30 0x7f0be00627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.067 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.061+0000 7f0bded9d700 1 --2- 172.21.15.160:0/111765479 >> v2:172.21.15.160:3300/0 conn(0x7f0be00c4210 0x7f0be0065780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.067 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bddd9b700 1 -- 172.21.15.160:0/111765479 >> v2:172.21.15.160:3300/0 conn(0x7f0be00c4210 msgr2=0x7f0be0065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:35.068 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bddd9b700 1 --2- 172.21.15.160:0/111765479 >> v2:172.21.15.160:3300/0 conn(0x7f0be00c4210 0x7f0be0065780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.068 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bdd59a700 1 -- 172.21.15.160:0/111765479 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488061001 0 0) 0x7f0be0064e10 con 0x7f0be00c3e30 2020-11-20T12:22:35.068 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bddd9b700 1 -- 172.21.15.160:0/111765479 >> v1:172.21.15.160:6789/0 conn(0x7f0be00c3e30 legacy=0x7f0be0150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.068 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bddd9b700 1 -- 172.21.15.160:0/111765479 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be01517e0 con 0x7f0be00c1d30 2020-11-20T12:22:35.069 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bddd9b700 1 --2- 172.21.15.160:0/111765479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c1d30 0x7f0be00627c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0be0068930 tx=0x7f0bd4006df0).ready entity=mon.0 client_cookie=3cb286c666934a70 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:35.069 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bdd59a700 1 -- 172.21.15.160:0/111765479 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40097b0 con 0x7f0be00c1d30 2020-11-20T12:22:35.069 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bdd59a700 1 -- 172.21.15.160:0/111765479 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4009910 con 0x7f0be00c1d30 2020-11-20T12:22:35.069 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.062+0000 7f0bdd59a700 1 -- 172.21.15.160:0/111765479 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4009c90 con 0x7f0be00c1d30 2020-11-20T12:22:35.069 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 -- 172.21.15.160:0/111765479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c1d30 msgr2=0x7f0be00627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 --2- 172.21.15.160:0/111765479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c1d30 0x7f0be00627c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f0be0068930 tx=0x7f0bd4006df0).stop 2020-11-20T12:22:35.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 -- 172.21.15.160:0/111765479 shutdown_connections 2020-11-20T12:22:35.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 --2- 172.21.15.160:0/111765479 >> v2:172.21.15.160:3300/0 conn(0x7f0be00c4210 0x7f0be0065780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 --2- 172.21.15.160:0/111765479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c1d30 0x7f0be00627c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.072 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 -- 172.21.15.160:0/111765479 >> 172.21.15.160:0/111765479 conn(0x7f0be0062ed0 msgr2=0x7f0be00632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:35.073 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 -- 172.21.15.160:0/111765479 shutdown_connections 2020-11-20T12:22:35.073 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.063+0000 7f0bdf59e700 1 -- 172.21.15.160:0/111765479 wait complete. 2020-11-20T12:22:35.076 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.065+0000 7f0bdf59e700 1 Processor -- start 2020-11-20T12:22:35.076 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.065+0000 7f0bdf59e700 1 -- start start 2020-11-20T12:22:35.076 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bdf59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be00c1d30 0x7f0be01579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.077 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bdf59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0be00c3e30 0x7f0be01442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.077 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bdf59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c4210 0x7f0be01447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.077 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bdf59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0155080 con 0x7f0be00c4210 2020-11-20T12:22:35.077 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bdf59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0144cd0 con 0x7f0be00c1d30 2020-11-20T12:22:35.077 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bdf59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0155310 con 0x7f0be00c3e30 2020-11-20T12:22:35.078 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bddd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0be00c3e30 0x7f0be01442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.078 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bde59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be00c1d30 0x7f0be01579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.078 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bddd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0be00c3e30 0x7f0be01442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38926/0 (socket says 172.21.15.160:38926) 2020-11-20T12:22:35.078 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bde59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be00c1d30 0x7f0be01579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52060/0 (socket says 172.21.15.160:52060) 2020-11-20T12:22:35.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bddd9b700 1 -- 172.21.15.160:0/2703395396 learned_addr learned my addr 172.21.15.160:0/2703395396 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:35.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.066+0000 7f0bded9d700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c4210 0x7f0be01447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bddd9b700 1 -- 172.21.15.160:0/2703395396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be00c1d30 msgr2=0x7f0be01579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bddd9b700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0be00c1d30 0x7f0be01579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.079 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bddd9b700 1 -- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c4210 msgr2=0x7f0be01447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bddd9b700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0be00c4210 0x7f0be01447e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bddd9b700 1 -- 172.21.15.160:0/2703395396 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be014e2e0 con 0x7f0be00c3e30 2020-11-20T12:22:35.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bddd9b700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0be00c3e30 0x7f0be01442f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f0be0066c40 tx=0x7f0bd4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:35.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4011d50 con 0x7f0be00c3e30 2020-11-20T12:22:35.080 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd401e460 con 0x7f0be00c3e30 2020-11-20T12:22:35.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd401e7e0 con 0x7f0be00c3e30 2020-11-20T12:22:35.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be014e540 con 0x7f0be00c3e30 2020-11-20T12:22:35.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.067+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be014ea80 con 0x7f0be00c3e30 2020-11-20T12:22:35.081 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.068+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0be0069460 con 0x7f0be00c3e30 2020-11-20T12:22:35.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.069+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0bd4025030 con 0x7f0be00c3e30 2020-11-20T12:22:35.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.070+0000 7f0bce7fc700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0bb4080630 0x7f0bb4082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.070+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f0bd40a3f00 con 0x7f0be00c3e30 2020-11-20T12:22:35.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.071+0000 7f0bde59c700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0bb4080630 0x7f0bb4082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.082 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.071+0000 7f0bce7fc700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f0bb4088c50 0x7f0bb408b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.071+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 --> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bb408b6d0 con 0x7f0bb4088c50 2020-11-20T12:22:35.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.071+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bd40a6570 con 0x7f0be00c3e30 2020-11-20T12:22:35.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.071+0000 7f0bded9d700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f0bb4088c50 0x7f0bb408b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.071+0000 7f0bde59c700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0bb4080630 0x7f0bb4082af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0bd00011a0 tx=0x7f0bd0007a00).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:35.083 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.072+0000 7f0bded9d700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f0bb4088c50 0x7f0bb408b070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:35.084 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.073+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== osd.8 v2:172.21.15.134:6808/22184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f0bb408b6d0 con 0x7f0bb4088c50 2020-11-20T12:22:35.104 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.100+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 --> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0be01580f0 con 0x7f0bb4088c50 2020-11-20T12:22:35.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.101+0000 7f0bce7fc700 1 -- 172.21.15.160:0/2703395396 <== osd.8 v2:172.21.15.134:6808/22184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0be01580f0 con 0x7f0bb4088c50 2020-11-20T12:22:35.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.101+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f0bb4088c50 msgr2=0x7f0bb408b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.101+0000 7f0bdf59e700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.134:6808/22184,v1:172.21.15.134:6809/22184] conn(0x7f0bb4088c50 0x7f0bb408b070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.105 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0bb4080630 msgr2=0x7f0bb4082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0bb4080630 0x7f0bb4082af0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0bd00011a0 tx=0x7f0bd0007a00).stop 2020-11-20T12:22:35.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0be00c3e30 msgr2=0x7f0be01442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 --2- 172.21.15.160:0/2703395396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0be00c3e30 0x7f0be01442f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f0be0066c40 tx=0x7f0bd4015000).stop 2020-11-20T12:22:35.106 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bded9d700 1 -- 172.21.15.160:0/2703395396 reap_dead start 2020-11-20T12:22:35.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 shutdown_connections 2020-11-20T12:22:35.107 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 >> 172.21.15.160:0/2703395396 conn(0x7f0be0062ed0 msgr2=0x7f0be00c0820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:35.107 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:35.107 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:35.107 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:35.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 shutdown_connections 2020-11-20T12:22:35.108 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.102+0000 7f0bdf59e700 1 -- 172.21.15.160:0/2703395396 wait complete. 2020-11-20T12:22:35.129 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2020-11-20T12:22:35.350 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.347+0000 7f2c2f0c0700 1 Processor -- start 2020-11-20T12:22:35.351 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.347+0000 7f2c2f0c0700 1 -- start start 2020-11-20T12:22:35.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2f0c0700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2c280630b0 0x7f2c28063490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2f0c0700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2c280c24d0 0x7f2c280c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.352 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2f0c0700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c280c3a80 con 0x7f2c28154230 2020-11-20T12:22:35.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2f0c0700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c280c4c30 con 0x7f2c280630b0 2020-11-20T12:22:35.353 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2f0c0700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c280c3d10 con 0x7f2c280c24d0 2020-11-20T12:22:35.354 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2d8bd700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f2c280c24d0 0x7f2c280c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2e8bf700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f2c28154230 0x7f2c281546a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56516/0 (socket says 172.21.15.160:56516) 2020-11-20T12:22:35.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2e8bf700 1 -- 172.21.15.160:0/683234891 learned_addr learned my addr 172.21.15.160:0/683234891 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:35.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.349+0000 7f2c2e0be700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f2c280630b0 0x7f2c28063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.355 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.350+0000 7f2c2e0be700 1 -- 172.21.15.160:0/683234891 >> v2:172.21.15.160:3300/0 conn(0x7f2c280c24d0 msgr2=0x7f2c280c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:35.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.350+0000 7f2c2e0be700 1 --2- 172.21.15.160:0/683234891 >> v2:172.21.15.160:3300/0 conn(0x7f2c280c24d0 0x7f2c280c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.350+0000 7f2c2e0be700 1 -- 172.21.15.160:0/683234891 >> v1:172.21.15.160:6789/0 conn(0x7f2c28154230 legacy=0x7f2c281546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.350+0000 7f2c2d0bc700 1 -- 172.21.15.160:0/683234891 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635105782 0 0) 0x7f2c280c3a80 con 0x7f2c28154230 2020-11-20T12:22:35.356 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.350+0000 7f2c2e0be700 1 -- 172.21.15.160:0/683234891 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280c3fb0 con 0x7f2c280630b0 2020-11-20T12:22:35.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.350+0000 7f2c2e0be700 1 --2- 172.21.15.160:0/683234891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c28063490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2c28063980 tx=0x7f2c24006df0).ready entity=mon.0 client_cookie=4cd1ba2686e2d806 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:35.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2d0bc700 1 -- 172.21.15.160:0/683234891 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24009840 con 0x7f2c280630b0 2020-11-20T12:22:35.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2d0bc700 1 -- 172.21.15.160:0/683234891 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c240099a0 con 0x7f2c280630b0 2020-11-20T12:22:35.357 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2d0bc700 1 -- 172.21.15.160:0/683234891 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c24009d20 con 0x7f2c280630b0 2020-11-20T12:22:35.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/683234891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 msgr2=0x7f2c28063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/683234891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c28063490 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f2c28063980 tx=0x7f2c24006df0).stop 2020-11-20T12:22:35.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/683234891 shutdown_connections 2020-11-20T12:22:35.358 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/683234891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c28063490 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/683234891 >> v2:172.21.15.160:3300/0 conn(0x7f2c280c24d0 0x7f2c280c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/683234891 >> 172.21.15.160:0/683234891 conn(0x7f2c28060140 msgr2=0x7f2c28060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:35.359 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.351+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/683234891 shutdown_connections 2020-11-20T12:22:35.360 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.352+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/683234891 wait complete. 2020-11-20T12:22:35.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.353+0000 7f2c2f0c0700 1 Processor -- start 2020-11-20T12:22:35.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.354+0000 7f2c2f0c0700 1 -- start start 2020-11-20T12:22:35.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2f0c0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c280c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2f0c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280c24d0 0x7f2c280c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.362 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2f0c0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c28154230 0x7f2c280c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2f0c0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28160da0 con 0x7f2c280630b0 2020-11-20T12:22:35.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2f0c0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28155470 con 0x7f2c280c24d0 2020-11-20T12:22:35.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2f0c0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c28160b00 con 0x7f2c28154230 2020-11-20T12:22:35.363 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2e0be700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c280c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2e8bf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c28154230 0x7f2c280c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2e0be700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c280c09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33230/0 (socket says 172.21.15.160:33230) 2020-11-20T12:22:35.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2d8bd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280c24d0 0x7f2c280c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.355+0000 7f2c2e0be700 1 -- 172.21.15.160:0/270742326 learned_addr learned my addr 172.21.15.160:0/270742326 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:35.364 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c2e8bf700 1 -- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280c24d0 msgr2=0x7f2c280c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.365 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c2e8bf700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280c24d0 0x7f2c280c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.365 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c2e8bf700 1 -- 172.21.15.160:0/270742326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 msgr2=0x7f2c280c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.365 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c2e8bf700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c280c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.365 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c2e8bf700 1 -- 172.21.15.160:0/270742326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c281556d0 con 0x7f2c28154230 2020-11-20T12:22:35.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c2e8bf700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c28154230 0x7f2c280c6420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2c2000c880 tx=0x7f2c20007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:35.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c167fc700 1 -- 172.21.15.160:0/270742326 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20005b80 con 0x7f2c28154230 2020-11-20T12:22:35.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c167fc700 1 -- 172.21.15.160:0/270742326 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c20005ce0 con 0x7f2c28154230 2020-11-20T12:22:35.366 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c28155970 con 0x7f2c28154230 2020-11-20T12:22:35.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.356+0000 7f2c167fc700 1 -- 172.21.15.160:0/270742326 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c20007340 con 0x7f2c28154230 2020-11-20T12:22:35.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.357+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c281560b0 con 0x7f2c28154230 2020-11-20T12:22:35.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.358+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28044f60 con 0x7f2c28154230 2020-11-20T12:22:35.367 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.359+0000 7f2c167fc700 1 -- 172.21.15.160:0/270742326 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2c20010030 con 0x7f2c28154230 2020-11-20T12:22:35.368 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.360+0000 7f2c167fc700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2c00080660 0x7f2c00082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:35.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.360+0000 7f2c167fc700 1 -- 172.21.15.160:0/270742326 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f2c200a2af0 con 0x7f2c28154230 2020-11-20T12:22:35.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.360+0000 7f2c2e0be700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2c00080660 0x7f2c00082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:35.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.361+0000 7f2c2e0be700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2c00080660 0x7f2c00082b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2c24009fd0 tx=0x7f2c24015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:35.369 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.362+0000 7f2c167fc700 1 -- 172.21.15.160:0/270742326 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2c200775e0 con 0x7f2c28154230 2020-11-20T12:22:35.550 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.547+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c28060d50 con 0x7f2c00080660 2020-11-20T12:22:35.550 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.547+0000 7f2c167fc700 1 -- 172.21.15.160:0/270742326 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2c28060d50 con 0x7f2c00080660 2020-11-20T12:22:35.556 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2c00080660 msgr2=0x7f2c00082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.557 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2c00080660 0x7f2c00082b20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2c24009fd0 tx=0x7f2c24015000).stop 2020-11-20T12:22:35.558 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c28154230 msgr2=0x7f2c280c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:35.560 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c28154230 0x7f2c280c6420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2c2000c880 tx=0x7f2c20007f10).stop 2020-11-20T12:22:35.560 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 shutdown_connections 2020-11-20T12:22:35.561 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f2c00080660 0x7f2c00082b20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.561 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c28154230 0x7f2c280c6420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.562 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c280630b0 0x7f2c280c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 --2- 172.21.15.160:0/270742326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c280c24d0 0x7f2c280c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:35.563 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 >> 172.21.15.160:0/270742326 conn(0x7f2c28060140 msgr2=0x7f2c28061ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:35.564 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 shutdown_connections 2020-11-20T12:22:35.565 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.550+0000 7f2c2f0c0700 1 -- 172.21.15.160:0/270742326 wait complete. 2020-11-20T12:22:35.565 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 8 to deep-scrub 2020-11-20T12:22:35.575 INFO:tasks.ceph:Scrubbing osd.11 2020-11-20T12:22:35.575 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2020-11-20T12:22:36.015 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.830+0000 7f10fb59e700 1 Processor -- start 2020-11-20T12:22:36.016 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.831+0000 7f10fb59e700 1 -- start start 2020-11-20T12:22:36.016 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.832+0000 7f10fb59e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10fc061870 0x7f10fc061c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.016 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.832+0000 7f10fb59e700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f10fc0bf390 0x7f10fc0bad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.016 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.832+0000 7f10fb59e700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f10fc0bb280 0x7f10fc0bc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.016 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.832+0000 7f10fb59e700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0c02e0 con 0x7f10fc0bb280 2020-11-20T12:22:36.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.832+0000 7f10fb59e700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0bf860 con 0x7f10fc0bf390 2020-11-20T12:22:36.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.832+0000 7f10fb59e700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc0bfb00 con 0x7f10fc061870 2020-11-20T12:22:36.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.833+0000 7f10fa59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10fc061870 0x7f10fc061c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.017 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.833+0000 7f10fa59c700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f10fc061870 0x7f10fc061c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38948/0 (socket says 172.21.15.160:38948) 2020-11-20T12:22:36.018 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.833+0000 7f10fa59c700 1 -- 172.21.15.160:0/2088984980 learned_addr learned my addr 172.21.15.160:0/2088984980 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:36.018 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.833+0000 7f10f1d9b700 1 --2- 172.21.15.160:0/2088984980 >> v2:172.21.15.150:3300/0 conn(0x7f10fc0bf390 0x7f10fc0bad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.018 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:35.833+0000 7f10fad9d700 1 --2- 172.21.15.160:0/2088984980 >> v2:172.21.15.134:3300/0 conn(0x7f10fc0bb280 0x7f10fc0bc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.019 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.013+0000 7f10fad9d700 1 -- 172.21.15.160:0/2088984980 >> v2:172.21.15.160:3300/0 conn(0x7f10fc061870 msgr2=0x7f10fc061c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:36.020 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.013+0000 7f10fad9d700 1 --2- 172.21.15.160:0/2088984980 >> v2:172.21.15.160:3300/0 conn(0x7f10fc061870 0x7f10fc061c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.020 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.013+0000 7f10fad9d700 1 -- 172.21.15.160:0/2088984980 >> v2:172.21.15.150:3300/0 conn(0x7f10fc0bf390 msgr2=0x7f10fc0bad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:36.020 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.013+0000 7f10fad9d700 1 --2- 172.21.15.160:0/2088984980 >> v2:172.21.15.150:3300/0 conn(0x7f10fc0bf390 0x7f10fc0bad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.020 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.013+0000 7f10fad9d700 1 -- 172.21.15.160:0/2088984980 --> v2:172.21.15.134:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0bfda0 con 0x7f10fc0bb280 2020-11-20T12:22:36.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.013+0000 7f10fa59c700 1 --2- 172.21.15.160:0/2088984980 >> v2:172.21.15.160:3300/0 conn(0x7f10fc061870 0x7f10fc061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:36.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.013+0000 7f10fad9d700 1 --2- 172.21.15.160:0/2088984980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0bb280 0x7f10fc0bc0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f10fc062140 tx=0x7f10f40091d0).ready entity=mon.0 client_cookie=c2b3d7ebcf7d44c7 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.014+0000 7f10f9d9b700 1 -- 172.21.15.160:0/2088984980 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400b9c0 con 0x7f10fc0bb280 2020-11-20T12:22:36.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.014+0000 7f10f9d9b700 1 -- 172.21.15.160:0/2088984980 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400bb20 con 0x7f10fc0bb280 2020-11-20T12:22:36.021 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.014+0000 7f10f9d9b700 1 -- 172.21.15.160:0/2088984980 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400bea0 con 0x7f10fc0bb280 2020-11-20T12:22:36.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.015+0000 7f10fb59e700 1 -- 172.21.15.160:0/2088984980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0bb280 msgr2=0x7f10fc0bc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.015+0000 7f10fb59e700 1 --2- 172.21.15.160:0/2088984980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0bb280 0x7f10fc0bc0d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f10fc062140 tx=0x7f10f40091d0).stop 2020-11-20T12:22:36.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.016+0000 7f10fb59e700 1 -- 172.21.15.160:0/2088984980 shutdown_connections 2020-11-20T12:22:36.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.016+0000 7f10fb59e700 1 --2- 172.21.15.160:0/2088984980 >> v2:172.21.15.160:3300/0 conn(0x7f10fc061870 0x7f10fc061c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.022 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.016+0000 7f10fb59e700 1 --2- 172.21.15.160:0/2088984980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0bb280 0x7f10fc0bc0d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.016+0000 7f10fb59e700 1 --2- 172.21.15.160:0/2088984980 >> v2:172.21.15.150:3300/0 conn(0x7f10fc0bf390 0x7f10fc0bad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.016+0000 7f10fb59e700 1 -- 172.21.15.160:0/2088984980 >> 172.21.15.160:0/2088984980 conn(0x7f10fc060140 msgr2=0x7f10fc060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:36.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.016+0000 7f10fb59e700 1 -- 172.21.15.160:0/2088984980 shutdown_connections 2020-11-20T12:22:36.023 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.016+0000 7f10fb59e700 1 -- 172.21.15.160:0/2088984980 wait complete. 2020-11-20T12:22:36.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.019+0000 7f10fb59e700 1 Processor -- start 2020-11-20T12:22:36.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.019+0000 7f10fb59e700 1 -- start start 2020-11-20T12:22:36.024 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.021+0000 7f10fb59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc061870 0x7f10fc15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.025 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.021+0000 7f10fb59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0bb280 0x7f10fc16d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.021+0000 7f10fb59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10fc0bf390 0x7f10fc1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.026 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fb59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc15df30 con 0x7f10fc061870 2020-11-20T12:22:36.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fb59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc15d120 con 0x7f10fc0bb280 2020-11-20T12:22:36.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fb59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc15a370 con 0x7f10fc0bf390 2020-11-20T12:22:36.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc061870 0x7f10fc15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.027 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc061870 0x7f10fc15cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.160:33244/0 (socket says 172.21.15.160:33244) 2020-11-20T12:22:36.028 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 -- 172.21.15.160:0/3353996880 learned_addr learned my addr 172.21.15.160:0/3353996880 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:36.028 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10f1d9b700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0bb280 0x7f10fc16d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.028 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fad9d700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10fc0bf390 0x7f10fc1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.028 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 -- 172.21.15.160:0/3353996880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10fc0bf390 msgr2=0x7f10fc1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.028 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10fc0bf390 0x7f10fc1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 -- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0bb280 msgr2=0x7f10fc16d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f10fc0bb280 0x7f10fc16d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.022+0000 7f10fa59c700 1 -- 172.21.15.160:0/3353996880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc15a610 con 0x7f10fc061870 2020-11-20T12:22:36.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.023+0000 7f10fa59c700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc061870 0x7f10fc15cb00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f10ec00fbb0 tx=0x7f10ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.029 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.023+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== mon.0 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00d8f0 con 0x7f10fc061870 2020-11-20T12:22:36.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.023+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== mon.0 v2:172.21.15.134:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec00c030 con 0x7f10fc061870 2020-11-20T12:22:36.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.023+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc15a8b0 con 0x7f10fc061870 2020-11-20T12:22:36.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.023+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== mon.0 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00dc60 con 0x7f10fc061870 2020-11-20T12:22:36.030 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.023+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc16d900 con 0x7f10fc061870 2020-11-20T12:22:36.031 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.024+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10fc15d3c0 con 0x7f10fc061870 2020-11-20T12:22:36.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.026+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== mon.0 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f10ec023070 con 0x7f10fc061870 2020-11-20T12:22:36.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.027+0000 7f10f2ffd700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f10d8080630 0x7f10d8082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.027+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== mon.0 v2:172.21.15.134:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f10ec0a2e70 con 0x7f10fc061870 2020-11-20T12:22:36.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.027+0000 7f10f1d9b700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f10d8080630 0x7f10d8082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.032 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.027+0000 7f10f2ffd700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f10d8088cd0 0x7f10d808b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.027+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 --> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10d808b750 con 0x7f10d8088cd0 2020-11-20T12:22:36.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.027+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== mon.0 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10ec0a3270 con 0x7f10fc061870 2020-11-20T12:22:36.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.028+0000 7f10f1d9b700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f10d8080630 0x7f10d8082af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f10fc05cb20 tx=0x7f10e400f040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.033 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.028+0000 7f10fad9d700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f10d8088cd0 0x7f10d808b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.028+0000 7f10fad9d700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f10d8088cd0 0x7f10d808b0f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.034 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.029+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== osd.11 v2:172.21.15.134:6824/22225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+21404 (crc 0 0 0) 0x7f10d808b750 con 0x7f10d8088cd0 2020-11-20T12:22:36.048 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.045+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 --> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f10fc069460 con 0x7f10d8088cd0 2020-11-20T12:22:36.049 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.046+0000 7f10f2ffd700 1 -- 172.21.15.160:0/3353996880 <== osd.11 v2:172.21.15.134:6824/22225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f10fc069460 con 0x7f10d8088cd0 2020-11-20T12:22:36.049 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2020-11-20T12:22:36.050 INFO:teuthology.orchestra.run.smithi160.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2020-11-20T12:22:36.050 INFO:teuthology.orchestra.run.smithi160.stdout:} 2020-11-20T12:22:36.051 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f10d8088cd0 msgr2=0x7f10d808b0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.051 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:6824/22225,v1:172.21.15.134:6825/22225] conn(0x7f10d8088cd0 0x7f10d808b0f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.051 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f10d8080630 msgr2=0x7f10d8082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.052 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f10d8080630 0x7f10d8082af0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f10fc05cb20 tx=0x7f10e400f040).stop 2020-11-20T12:22:36.052 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc061870 msgr2=0x7f10fc15cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.052 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 --2- 172.21.15.160:0/3353996880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc061870 0x7f10fc15cb00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f10ec00fbb0 tx=0x7f10ec008040).stop 2020-11-20T12:22:36.052 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fad9d700 1 -- 172.21.15.160:0/3353996880 reap_dead start 2020-11-20T12:22:36.052 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 shutdown_connections 2020-11-20T12:22:36.053 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 >> 172.21.15.160:0/3353996880 conn(0x7f10fc060140 msgr2=0x7f10fc0c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:36.053 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 shutdown_connections 2020-11-20T12:22:36.053 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.047+0000 7f10fb59e700 1 -- 172.21.15.160:0/3353996880 wait complete. 2020-11-20T12:22:36.074 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2020-11-20T12:22:36.294 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.291+0000 7f5fb3fa8700 1 Processor -- start 2020-11-20T12:22:36.295 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.292+0000 7f5fb3fa8700 1 -- start start 2020-11-20T12:22:36.299 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.293+0000 7f5fb3fa8700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5fac064af0 0x7f5fac064ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.300 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.293+0000 7f5fb3fa8700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5fac151020 0x7f5fac151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.300 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.293+0000 7f5fb3fa8700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fac0c0aa0 con 0x7f5fac063620 2020-11-20T12:22:36.300 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.293+0000 7f5fb3fa8700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fac062700 con 0x7f5fac151020 2020-11-20T12:22:36.300 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.293+0000 7f5fb3fa8700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fac0629a0 con 0x7f5fac064af0 2020-11-20T12:22:36.301 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.293+0000 7f5fb1d44700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5fac064af0 0x7f5fac064ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.301 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb1543700 1 --1- >> v1:172.21.15.160:6789/0 conn(0x7f5fac063620 0x7f5fac0c0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56546/0 (socket says 172.21.15.160:56546) 2020-11-20T12:22:36.301 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb2545700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7f5fac151020 0x7f5fac151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.301 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb1d44700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f5fac064af0 0x7f5fac064ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38964/0 (socket says 172.21.15.160:38964) 2020-11-20T12:22:36.301 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb1543700 1 -- 172.21.15.160:0/784604914 learned_addr learned my addr 172.21.15.160:0/784604914 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:36.302 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb1d44700 1 -- 172.21.15.160:0/784604914 >> v2:172.21.15.150:3300/0 conn(0x7f5fac151020 msgr2=0x7f5fac151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:36.302 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb1d44700 1 --2- 172.21.15.160:0/784604914 >> v2:172.21.15.150:3300/0 conn(0x7f5fac151020 0x7f5fac151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.302 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb1d44700 1 -- 172.21.15.160:0/784604914 >> v1:172.21.15.160:6789/0 conn(0x7f5fac063620 legacy=0x7f5fac0c0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.302 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb1d44700 1 -- 172.21.15.160:0/784604914 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac062c40 con 0x7f5fac064af0 2020-11-20T12:22:36.302 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb2545700 1 --2- 172.21.15.160:0/784604914 >> v2:172.21.15.150:3300/0 conn(0x7f5fac151020 0x7f5fac151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:36.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.294+0000 7f5fb0d42700 1 -- 172.21.15.160:0/784604914 <== mon.2 v1:172.21.15.160:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578114143 0 0) 0x7f5fac0c0aa0 con 0x7f5fac063620 2020-11-20T12:22:36.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb1d44700 1 --2- 172.21.15.160:0/784604914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac064af0 0x7f5fac064ed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5fa800b990 tx=0x7f5fa8006d90).ready entity=mon.2 client_cookie=c97ffbeabceb3076 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb0d42700 1 -- 172.21.15.160:0/784604914 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8006030 con 0x7f5fac064af0 2020-11-20T12:22:36.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb0d42700 1 -- 172.21.15.160:0/784604914 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8006190 con 0x7f5fac064af0 2020-11-20T12:22:36.303 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb0d42700 1 -- 172.21.15.160:0/784604914 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8006510 con 0x7f5fac064af0 2020-11-20T12:22:36.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/784604914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac064af0 msgr2=0x7f5fac064ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/784604914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac064af0 0x7f5fac064ed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5fa800b990 tx=0x7f5fa8006d90).stop 2020-11-20T12:22:36.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/784604914 shutdown_connections 2020-11-20T12:22:36.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/784604914 >> v2:172.21.15.150:3300/0 conn(0x7f5fac151020 0x7f5fac151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.304 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/784604914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac064af0 0x7f5fac064ed0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.305 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.295+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/784604914 >> 172.21.15.160:0/784604914 conn(0x7f5fac0c7300 msgr2=0x7f5fac0c76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:36.305 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.296+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/784604914 shutdown_connections 2020-11-20T12:22:36.305 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.296+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/784604914 wait complete. 2020-11-20T12:22:36.307 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.297+0000 7f5fb3fa8700 1 Processor -- start 2020-11-20T12:22:36.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.297+0000 7f5fb3fa8700 1 -- start start 2020-11-20T12:22:36.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb3fa8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac063620 0x7f5fac160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb3fa8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fac064af0 0x7f5fac0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.308 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb3fa8700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac151020 0x7f5fac157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.309 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb3fa8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac112220 con 0x7f5fac064af0 2020-11-20T12:22:36.309 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb3fa8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1124c0 con 0x7f5fac063620 2020-11-20T12:22:36.309 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb3fa8700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac112760 con 0x7f5fac151020 2020-11-20T12:22:36.309 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb2545700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac151020 0x7f5fac157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.309 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb1d44700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac063620 0x7f5fac160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb2545700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac151020 0x7f5fac157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38974/0 (socket says 172.21.15.160:38974) 2020-11-20T12:22:36.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.298+0000 7f5fb2545700 1 -- 172.21.15.160:0/1163161154 learned_addr learned my addr 172.21.15.160:0/1163161154 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:36.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb1543700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fac064af0 0x7f5fac0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb2545700 1 -- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac063620 msgr2=0x7f5fac160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.310 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb2545700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac063620 0x7f5fac160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb2545700 1 -- 172.21.15.160:0/1163161154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fac064af0 msgr2=0x7f5fac0c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb2545700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fac064af0 0x7f5fac0c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb2545700 1 -- 172.21.15.160:0/1163161154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac161870 con 0x7f5fac151020 2020-11-20T12:22:36.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb1543700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fac064af0 0x7f5fac0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:22:36.311 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb2545700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac151020 0x7f5fac157fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5fa400ef30 tx=0x7f5fa40091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5f99ffb700 1 -- 172.21.15.160:0/1163161154 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa400cdd0 con 0x7f5fac151020 2020-11-20T12:22:36.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5f99ffb700 1 -- 172.21.15.160:0/1163161154 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa40123f0 con 0x7f5fac151020 2020-11-20T12:22:36.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac161b10 con 0x7f5fac151020 2020-11-20T12:22:36.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.299+0000 7f5f99ffb700 1 -- 172.21.15.160:0/1163161154 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4012790 con 0x7f5fac151020 2020-11-20T12:22:36.312 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.300+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac111ee0 con 0x7f5fac151020 2020-11-20T12:22:36.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.301+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fac1616e0 con 0x7f5fac151020 2020-11-20T12:22:36.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.302+0000 7f5f99ffb700 1 -- 172.21.15.160:0/1163161154 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5fa4022070 con 0x7f5fac151020 2020-11-20T12:22:36.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.303+0000 7f5f99ffb700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5f84080630 0x7f5f84082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.303+0000 7f5f99ffb700 1 -- 172.21.15.160:0/1163161154 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f5fa40a32e0 con 0x7f5fac151020 2020-11-20T12:22:36.313 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.303+0000 7f5fb1d44700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5f84080630 0x7f5f84082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.314 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.304+0000 7f5fb1d44700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5f84080630 0x7f5f84082af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5fa8006dd0 tx=0x7f5fa8015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.314 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.310+0000 7f5f99ffb700 1 -- 172.21.15.160:0/1163161154 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5fa4077e00 con 0x7f5fac151020 2020-11-20T12:22:36.495 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.492+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fac0611b0 con 0x7f5f84080630 2020-11-20T12:22:36.496 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.493+0000 7f5f99ffb700 1 -- 172.21.15.160:0/1163161154 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f5fac0611b0 con 0x7f5f84080630 2020-11-20T12:22:36.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5f84080630 msgr2=0x7f5f84082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.498 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5f84080630 0x7f5f84082af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5fa8006dd0 tx=0x7f5fa8015000).stop 2020-11-20T12:22:36.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac151020 msgr2=0x7f5fac157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac151020 0x7f5fac157fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5fa400ef30 tx=0x7f5fa40091d0).stop 2020-11-20T12:22:36.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 shutdown_connections 2020-11-20T12:22:36.499 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f5f84080630 0x7f5f84082af0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac151020 0x7f5fac157fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac063620 0x7f5fac160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 --2- 172.21.15.160:0/1163161154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5fac064af0 0x7f5fac0c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.495+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 >> 172.21.15.160:0/1163161154 conn(0x7f5fac0c7300 msgr2=0x7f5fac0bf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:36.500 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.496+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 shutdown_connections 2020-11-20T12:22:36.501 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.496+0000 7f5fb3fa8700 1 -- 172.21.15.160:0/1163161154 wait complete. 2020-11-20T12:22:36.501 INFO:teuthology.orchestra.run.smithi160.stderr:instructed osd(s) 11 to deep-scrub 2020-11-20T12:22:36.523 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:22:36.743 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.740+0000 7fdea2e51700 1 Processor -- start 2020-11-20T12:22:36.744 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.740+0000 7fdea2e51700 1 -- start start 2020-11-20T12:22:36.745 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.741+0000 7fdea2e51700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fde9c0bff50 0x7fde9c0bbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.745 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.741+0000 7fdea2e51700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fde9c155270 0x7fde9c0619c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.746 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.741+0000 7fdea2e51700 1 -- --> v1:172.21.15.134:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9c0bc4a0 con 0x7fde9c0bfb70 2020-11-20T12:22:36.746 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.741+0000 7fdea2e51700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c155b30 con 0x7fde9c155270 2020-11-20T12:22:36.746 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea2e51700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9c155dd0 con 0x7fde9c0bff50 2020-11-20T12:22:36.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea164e700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fde9c0bff50 0x7fde9c0bbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea1e4f700 1 --1- >> v1:172.21.15.134:6789/0 conn(0x7fde9c0bfb70 0x7fde9c0657e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.134:6789/0 says I am v1:172.21.15.160:33054/0 (socket says 172.21.15.160:33054) 2020-11-20T12:22:36.747 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea1e4f700 1 -- 172.21.15.160:0/258009976 learned_addr learned my addr 172.21.15.160:0/258009976 (peer_addr_for_me v1:172.21.15.160:0/0) 2020-11-20T12:22:36.748 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea2650700 1 --2- 172.21.15.160:0/258009976 >> v2:172.21.15.150:3300/0 conn(0x7fde9c155270 0x7fde9c0619c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea2650700 1 -- 172.21.15.160:0/258009976 >> v2:172.21.15.160:3300/0 conn(0x7fde9c0bff50 msgr2=0x7fde9c0bbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:36.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea2650700 1 --2- 172.21.15.160:0/258009976 >> v2:172.21.15.160:3300/0 conn(0x7fde9c0bff50 0x7fde9c0bbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.750 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea2650700 1 -- 172.21.15.160:0/258009976 >> v1:172.21.15.134:6789/0 conn(0x7fde9c0bfb70 legacy=0x7fde9c0657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea2650700 1 -- 172.21.15.160:0/258009976 --> v2:172.21.15.150:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c156070 con 0x7fde9c155270 2020-11-20T12:22:36.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.742+0000 7fdea0e4d700 1 -- 172.21.15.160:0/258009976 <== mon.0 v1:172.21.15.134:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028763707 0 0) 0x7fde9c0bc4a0 con 0x7fde9c0bfb70 2020-11-20T12:22:36.751 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.743+0000 7fdea2650700 1 --2- 172.21.15.160:0/258009976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c155270 0x7fde9c0619c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fde9c0644f0 tx=0x7fde94006df0).ready entity=mon.1 client_cookie=45b7c632318c2e90 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.743+0000 7fdea0e4d700 1 -- 172.21.15.160:0/258009976 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde940097b0 con 0x7fde9c155270 2020-11-20T12:22:36.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.743+0000 7fdea0e4d700 1 -- 172.21.15.160:0/258009976 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde94009910 con 0x7fde9c155270 2020-11-20T12:22:36.752 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.743+0000 7fdea0e4d700 1 -- 172.21.15.160:0/258009976 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde94009c90 con 0x7fde9c155270 2020-11-20T12:22:36.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.743+0000 7fdea2e51700 1 -- 172.21.15.160:0/258009976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c155270 msgr2=0x7fde9c0619c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.743+0000 7fdea2e51700 1 --2- 172.21.15.160:0/258009976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c155270 0x7fde9c0619c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fde9c0644f0 tx=0x7fde94006df0).stop 2020-11-20T12:22:36.753 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.744+0000 7fdea2e51700 1 -- 172.21.15.160:0/258009976 shutdown_connections 2020-11-20T12:22:36.754 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.744+0000 7fdea2e51700 1 --2- 172.21.15.160:0/258009976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c155270 0x7fde9c0619c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.744+0000 7fdea2e51700 1 --2- 172.21.15.160:0/258009976 >> v2:172.21.15.160:3300/0 conn(0x7fde9c0bff50 0x7fde9c0bbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.758 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.744+0000 7fdea2e51700 1 -- 172.21.15.160:0/258009976 >> 172.21.15.160:0/258009976 conn(0x7fde9c062ef0 msgr2=0x7fde9c063300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:36.759 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.744+0000 7fdea2e51700 1 -- 172.21.15.160:0/258009976 shutdown_connections 2020-11-20T12:22:36.759 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.744+0000 7fdea2e51700 1 -- 172.21.15.160:0/258009976 wait complete. 2020-11-20T12:22:36.759 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.745+0000 7fdea2e51700 1 Processor -- start 2020-11-20T12:22:36.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.745+0000 7fdea2e51700 1 -- start start 2020-11-20T12:22:36.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2e51700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0bfb70 0x7fde9c167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.760 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2e51700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c0bff50 0x7fde9c0bee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.761 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2e51700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde9c155270 0x7fde9c14d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.761 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2e51700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c155050 con 0x7fde9c0bff50 2020-11-20T12:22:36.761 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2e51700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c15a5a0 con 0x7fde9c0bfb70 2020-11-20T12:22:36.762 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2e51700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9c168480 con 0x7fde9c155270 2020-11-20T12:22:36.762 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2650700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde9c155270 0x7fde9c14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.762 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea1e4f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0bfb70 0x7fde9c167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.763 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2650700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde9c155270 0x7fde9c14d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38988/0 (socket says 172.21.15.160:38988) 2020-11-20T12:22:36.763 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea2650700 1 -- 172.21.15.160:0/1623015608 learned_addr learned my addr 172.21.15.160:0/1623015608 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:36.763 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.746+0000 7fdea1e4f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0bfb70 0x7fde9c167f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52120/0 (socket says 172.21.15.160:52120) 2020-11-20T12:22:36.764 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea164e700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c0bff50 0x7fde9c0bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.764 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea1e4f700 1 -- 172.21.15.160:0/1623015608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde9c155270 msgr2=0x7fde9c14d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.764 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea1e4f700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde9c155270 0x7fde9c14d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.764 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea1e4f700 1 -- 172.21.15.160:0/1623015608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c0bff50 msgr2=0x7fde9c0bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.765 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea1e4f700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c0bff50 0x7fde9c0bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.765 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea1e4f700 1 -- 172.21.15.160:0/1623015608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c156940 con 0x7fde9c0bfb70 2020-11-20T12:22:36.765 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea2650700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde9c155270 0x7fde9c14d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:36.766 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fdea1e4f700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0bfb70 0x7fde9c167f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fde9800c880 tx=0x7fde9800cb90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.766 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.747+0000 7fde89ffb700 1 -- 172.21.15.160:0/1623015608 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98005b80 con 0x7fde9c0bfb70 2020-11-20T12:22:36.766 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.748+0000 7fde89ffb700 1 -- 172.21.15.160:0/1623015608 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde98005ce0 con 0x7fde9c0bfb70 2020-11-20T12:22:36.767 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.748+0000 7fde89ffb700 1 -- 172.21.15.160:0/1623015608 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98007340 con 0x7fde9c0bfb70 2020-11-20T12:22:36.767 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.748+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9c156be0 con 0x7fde9c0bfb70 2020-11-20T12:22:36.767 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.748+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9c15aaa0 con 0x7fde9c0bfb70 2020-11-20T12:22:36.768 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.749+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde9c044f60 con 0x7fde9c0bfb70 2020-11-20T12:22:36.768 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.750+0000 7fde89ffb700 1 -- 172.21.15.160:0/1623015608 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fde98010030 con 0x7fde9c0bfb70 2020-11-20T12:22:36.768 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.751+0000 7fde89ffb700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fde74080660 0x7fde74082b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:36.769 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.751+0000 7fde89ffb700 1 -- 172.21.15.160:0/1623015608 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fde980a2b60 con 0x7fde9c0bfb70 2020-11-20T12:22:36.769 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.751+0000 7fdea164e700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fde74080660 0x7fde74082b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:36.769 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.752+0000 7fdea164e700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fde74080660 0x7fde74082b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fde9c0670c0 tx=0x7fde8c008040).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:36.770 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.753+0000 7fde89ffb700 1 -- 172.21.15.160:0/1623015608 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fde98077650 con 0x7fde9c0bfb70 2020-11-20T12:22:36.937 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.933+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde9c0bf300 con 0x7fde74080660 2020-11-20T12:22:36.943 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.940+0000 7fde89ffb700 1 -- 172.21.15.160:0/1623015608 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+148938 (secure 0 0 0) 0x7fde9c0bf300 con 0x7fde74080660 2020-11-20T12:22:36.946 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:22:36.947 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fde74080660 msgr2=0x7fde74082b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.948 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fde74080660 0x7fde74082b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fde9c0670c0 tx=0x7fde8c008040).stop 2020-11-20T12:22:36.948 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0bfb70 msgr2=0x7fde9c167f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:36.948 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0bfb70 0x7fde9c167f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fde9800c880 tx=0x7fde9800cb90).stop 2020-11-20T12:22:36.948 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 shutdown_connections 2020-11-20T12:22:36.948 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fde74080660 0x7fde74082b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde9c155270 0x7fde9c14d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde9c0bfb70 0x7fde9c167f90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 --2- 172.21.15.160:0/1623015608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde9c0bff50 0x7fde9c0bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 >> 172.21.15.160:0/1623015608 conn(0x7fde9c062ef0 msgr2=0x7fde9c0632d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:36.949 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.944+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 shutdown_connections 2020-11-20T12:22:36.950 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:36.945+0000 7fdea2e51700 1 -- 172.21.15.160:0/1623015608 wait complete. 2020-11-20T12:22:36.950 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2020-11-20T12:22:36.970 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2020-11-20T12:22:36.200194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":217795658,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":1318,"num_read_kb":4884,"num_write":116319,"num_write_kb":1168332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86663,"ondisk_log_size":86663,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124392560,"kb_used":10075780,"kb_used_data":1114316804,"kb_used_omap":188498,"kb_used_meta":0,"kb_avail":1114316780,"statfs":{"total":1151377981440,"available":1141060382720,"internally_reserved":24576,"allocated":1141060407296,"data_stored":1141060407296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":193022741,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-394120,"num_objects":-8,"num_object_clones":0,"num_object_copies":-16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003011"},"pg_stats":[{"pgid":"4.2","version":"26'12175","reported_seq":"12187","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:31.701656+0000","last_change":"2020-11-20T12:22:31.701702+0000","last_active":"2020-11-20T12:22:31.701656+0000","last_peered":"2020-11-20T12:22:31.701656+0000","last_clean":"2020-11-20T12:22:31.701656+0000","last_became_active":"2020-11-20T12:14:10.894103+0000","last_became_peered":"2020-11-20T12:14:10.894103+0000","last_unstale":"2020-11-20T12:22:31.701656+0000","last_undegraded":"2020-11-20T12:22:31.701656+0000","last_fullsized":"2020-11-20T12:22:31.701656+0000","mapping_epoch":24,"log_start":"26'2100","ondisk_log_start":"26'2100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12175","last_scrub_stamp":"2020-11-20T12:22:31.701652+0000","last_deep_scrub":"26'12175","last_deep_scrub_stamp":"2020-11-20T12:22:31.701652+0000","last_clean_scrub_stamp":"2020-11-20T12:22:31.701652+0000","log_size":10075,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13374,"num_write_kb":78386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:33.220425+0000","last_change":"2020-11-20T12:22:33.220487+0000","last_active":"2020-11-20T12:22:33.220425+0000","last_peered":"2020-11-20T12:22:33.220425+0000","last_clean":"2020-11-20T12:22:33.220425+0000","last_became_active":"2020-11-20T12:14:06.159519+0000","last_became_peered":"2020-11-20T12:14:06.159519+0000","last_unstale":"2020-11-20T12:22:33.220425+0000","last_undegraded":"2020-11-20T12:22:33.220425+0000","last_fullsized":"2020-11-20T12:22:33.220425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:33.220419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:33.220419+0000","last_clean_scrub_stamp":"2020-11-20T12:22:33.220419+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'960","reported_seq":"970","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.576220+0000","last_change":"2020-11-20T12:14:10.335478+0000","last_active":"2020-11-20T12:22:23.576220+0000","last_peered":"2020-11-20T12:22:23.576220+0000","last_clean":"2020-11-20T12:22:23.576220+0000","last_became_active":"2020-11-20T12:14:10.335057+0000","last_became_peered":"2020-11-20T12:14:10.335057+0000","last_unstale":"2020-11-20T12:22:23.576220+0000","last_undegraded":"2020-11-20T12:22:23.576220+0000","last_fullsized":"2020-11-20T12:22:23.576220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":960,"ondisk_log_size":960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41943200,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":1222,"num_write_kb":97964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'12274","reported_seq":"12283","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.569542+0000","last_change":"2020-11-20T12:14:10.896061+0000","last_active":"2020-11-20T12:22:23.569542+0000","last_peered":"2020-11-20T12:22:23.569542+0000","last_clean":"2020-11-20T12:22:23.569542+0000","last_became_active":"2020-11-20T12:14:10.895690+0000","last_became_peered":"2020-11-20T12:14:10.895690+0000","last_unstale":"2020-11-20T12:22:23.569542+0000","last_undegraded":"2020-11-20T12:22:23.569542+0000","last_fullsized":"2020-11-20T12:22:23.569542+0000","mapping_epoch":24,"log_start":"26'2200","ondisk_log_start":"26'2200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10074,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13504,"num_write_kb":81662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.883428+0000","last_change":"2020-11-20T12:14:07.008579+0000","last_active":"2020-11-20T12:14:10.883428+0000","last_peered":"2020-11-20T12:14:10.883428+0000","last_clean":"2020-11-20T12:14:10.883428+0000","last_became_active":"2020-11-20T12:14:07.008291+0000","last_became_peered":"2020-11-20T12:14:07.008291+0000","last_unstale":"2020-11-20T12:14:10.883428+0000","last_undegraded":"2020-11-20T12:14:10.883428+0000","last_fullsized":"2020-11-20T12:14:10.883428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'614","reported_seq":"624","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.512130+0000","last_change":"2020-11-20T12:14:10.534558+0000","last_active":"2020-11-20T12:22:23.512130+0000","last_peered":"2020-11-20T12:22:23.512130+0000","last_clean":"2020-11-20T12:22:23.512130+0000","last_became_active":"2020-11-20T12:14:10.534094+0000","last_became_peered":"2020-11-20T12:14:10.534094+0000","last_unstale":"2020-11-20T12:22:23.512130+0000","last_undegraded":"2020-11-20T12:22:23.512130+0000","last_fullsized":"2020-11-20T12:22:23.512130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":614,"ondisk_log_size":614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360162,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":932,"num_write_kb":65028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"26'12061","reported_seq":"12070","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.573548+0000","last_change":"2020-11-20T12:14:10.899194+0000","last_active":"2020-11-20T12:22:23.573548+0000","last_peered":"2020-11-20T12:22:23.573548+0000","last_clean":"2020-11-20T12:22:23.573548+0000","last_became_active":"2020-11-20T12:14:10.898829+0000","last_became_peered":"2020-11-20T12:14:10.898829+0000","last_unstale":"2020-11-20T12:22:23.573548+0000","last_undegraded":"2020-11-20T12:22:23.573548+0000","last_fullsized":"2020-11-20T12:22:23.573548+0000","mapping_epoch":24,"log_start":"26'2000","ondisk_log_start":"26'2000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10061,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13210,"num_write_kb":79226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:33.117012+0000","last_change":"2020-11-20T12:22:33.117079+0000","last_active":"2020-11-20T12:22:33.117012+0000","last_peered":"2020-11-20T12:22:33.117012+0000","last_clean":"2020-11-20T12:22:33.117012+0000","last_became_active":"2020-11-20T12:14:07.008127+0000","last_became_peered":"2020-11-20T12:14:07.008127+0000","last_unstale":"2020-11-20T12:22:33.117012+0000","last_undegraded":"2020-11-20T12:22:33.117012+0000","last_fullsized":"2020-11-20T12:22:33.117012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:33.117008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:33.117008+0000","last_clean_scrub_stamp":"2020-11-20T12:22:33.117008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'662","reported_seq":"672","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.515597+0000","last_change":"2020-11-20T12:14:10.341124+0000","last_active":"2020-11-20T12:22:23.515597+0000","last_peered":"2020-11-20T12:22:23.515597+0000","last_clean":"2020-11-20T12:22:23.515597+0000","last_became_active":"2020-11-20T12:14:10.340407+0000","last_became_peered":"2020-11-20T12:14:10.340407+0000","last_unstale":"2020-11-20T12:22:23.515597+0000","last_undegraded":"2020-11-20T12:22:23.515597+0000","last_fullsized":"2020-11-20T12:22:23.515597+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":662,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":944,"num_write_kb":72883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'12189","reported_seq":"12198","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.560063+0000","last_change":"2020-11-20T12:14:10.894433+0000","last_active":"2020-11-20T12:22:23.560063+0000","last_peered":"2020-11-20T12:22:23.560063+0000","last_clean":"2020-11-20T12:22:23.560063+0000","last_became_active":"2020-11-20T12:14:10.894032+0000","last_became_peered":"2020-11-20T12:14:10.894032+0000","last_unstale":"2020-11-20T12:22:23.560063+0000","last_undegraded":"2020-11-20T12:22:23.560063+0000","last_fullsized":"2020-11-20T12:22:23.560063+0000","mapping_epoch":24,"log_start":"26'2100","ondisk_log_start":"26'2100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13414,"num_write_kb":79172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.889703+0000","last_change":"2020-11-20T12:14:06.159050+0000","last_active":"2020-11-20T12:14:10.889703+0000","last_peered":"2020-11-20T12:14:10.889703+0000","last_clean":"2020-11-20T12:14:10.889703+0000","last_became_active":"2020-11-20T12:14:06.158623+0000","last_became_peered":"2020-11-20T12:14:06.158623+0000","last_unstale":"2020-11-20T12:14:10.889703+0000","last_undegraded":"2020-11-20T12:14:10.889703+0000","last_fullsized":"2020-11-20T12:14:10.889703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"19","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891446+0000","last_change":"2020-11-20T12:13:58.998090+0000","last_active":"2020-11-20T12:14:10.891446+0000","last_peered":"2020-11-20T12:14:10.891446+0000","last_clean":"2020-11-20T12:14:10.891446+0000","last_became_active":"2020-11-20T12:13:58.997799+0000","last_became_peered":"2020-11-20T12:13:58.997799+0000","last_unstale":"2020-11-20T12:14:10.891446+0000","last_undegraded":"2020-11-20T12:14:10.891446+0000","last_fullsized":"2020-11-20T12:14:10.891446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:13:54.281756+0000","last_clean_scrub_stamp":"2020-11-20T12:13:54.281756+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"26'704","reported_seq":"714","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:28.313777+0000","last_change":"2020-11-20T12:14:10.537982+0000","last_active":"2020-11-20T12:22:28.313777+0000","last_peered":"2020-11-20T12:22:28.313777+0000","last_clean":"2020-11-20T12:22:28.313777+0000","last_became_active":"2020-11-20T12:14:10.537671+0000","last_became_peered":"2020-11-20T12:14:10.537671+0000","last_unstale":"2020-11-20T12:22:28.313777+0000","last_undegraded":"2020-11-20T12:22:28.313777+0000","last_fullsized":"2020-11-20T12:22:28.313777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":704,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37156902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":1013,"num_write_kb":80798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.6","version":"26'11965","reported_seq":"11977","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:32.733313+0000","last_change":"2020-11-20T12:22:32.733375+0000","last_active":"2020-11-20T12:22:32.733313+0000","last_peered":"2020-11-20T12:22:32.733313+0000","last_clean":"2020-11-20T12:22:32.733313+0000","last_became_active":"2020-11-20T12:14:10.894932+0000","last_became_peered":"2020-11-20T12:14:10.894932+0000","last_unstale":"2020-11-20T12:22:32.733313+0000","last_undegraded":"2020-11-20T12:22:32.733313+0000","last_fullsized":"2020-11-20T12:22:32.733313+0000","mapping_epoch":24,"log_start":"26'1900","ondisk_log_start":"26'1900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11965","last_scrub_stamp":"2020-11-20T12:22:32.733309+0000","last_deep_scrub":"26'11965","last_deep_scrub_stamp":"2020-11-20T12:22:32.733309+0000","last_clean_scrub_stamp":"2020-11-20T12:22:32.733309+0000","log_size":10065,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13123,"num_write_kb":78974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.891316+0000","last_change":"2020-11-20T12:14:06.162793+0000","last_active":"2020-11-20T12:14:10.891316+0000","last_peered":"2020-11-20T12:14:10.891316+0000","last_clean":"2020-11-20T12:14:10.891316+0000","last_became_active":"2020-11-20T12:14:06.162506+0000","last_became_peered":"2020-11-20T12:14:06.162506+0000","last_unstale":"2020-11-20T12:14:10.891316+0000","last_undegraded":"2020-11-20T12:14:10.891316+0000","last_fullsized":"2020-11-20T12:14:10.891316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"26'1280","reported_seq":"2059","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:33.363550+0000","last_change":"2020-11-20T12:22:33.363602+0000","last_active":"2020-11-20T12:22:33.363550+0000","last_peered":"2020-11-20T12:22:33.363550+0000","last_clean":"2020-11-20T12:22:33.363550+0000","last_became_active":"2020-11-20T12:14:10.336077+0000","last_became_peered":"2020-11-20T12:14:10.336077+0000","last_unstale":"2020-11-20T12:22:33.363550+0000","last_undegraded":"2020-11-20T12:22:33.363550+0000","last_fullsized":"2020-11-20T12:22:33.363550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1280","last_scrub_stamp":"2020-11-20T12:22:33.363543+0000","last_deep_scrub":"26'1280","last_deep_scrub_stamp":"2020-11-20T12:22:33.363543+0000","last_clean_scrub_stamp":"2020-11-20T12:22:33.363543+0000","log_size":1280,"ondisk_log_size":1280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":833,"num_read_kb":4591,"num_write":1588,"num_write_kb":41099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"26'12431","reported_seq":"12443","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:28.400779+0000","last_change":"2020-11-20T12:22:28.400829+0000","last_active":"2020-11-20T12:22:28.400779+0000","last_peered":"2020-11-20T12:22:28.400779+0000","last_clean":"2020-11-20T12:22:28.400779+0000","last_became_active":"2020-11-20T12:14:10.896333+0000","last_became_peered":"2020-11-20T12:14:10.896333+0000","last_unstale":"2020-11-20T12:22:28.400779+0000","last_undegraded":"2020-11-20T12:22:28.400779+0000","last_fullsized":"2020-11-20T12:22:28.400779+0000","mapping_epoch":24,"log_start":"26'2400","ondisk_log_start":"26'2400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12431","last_scrub_stamp":"2020-11-20T12:22:28.400775+0000","last_deep_scrub":"26'12431","last_deep_scrub_stamp":"2020-11-20T12:22:28.400775+0000","last_clean_scrub_stamp":"2020-11-20T12:22:28.400775+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13626,"num_write_kb":83115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:32.371709+0000","last_change":"2020-11-20T12:22:32.371782+0000","last_active":"2020-11-20T12:22:32.371709+0000","last_peered":"2020-11-20T12:22:32.371709+0000","last_clean":"2020-11-20T12:22:32.371709+0000","last_became_active":"2020-11-20T12:14:06.162783+0000","last_became_peered":"2020-11-20T12:14:06.162783+0000","last_unstale":"2020-11-20T12:22:32.371709+0000","last_undegraded":"2020-11-20T12:22:32.371709+0000","last_fullsized":"2020-11-20T12:22:32.371709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:32.371702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:32.371702+0000","last_clean_scrub_stamp":"2020-11-20T12:22:32.371702+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'755","reported_seq":"765","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.317304+0000","last_change":"2020-11-20T12:14:10.339850+0000","last_active":"2020-11-20T12:22:23.317304+0000","last_peered":"2020-11-20T12:22:23.317304+0000","last_clean":"2020-11-20T12:22:23.317304+0000","last_became_active":"2020-11-20T12:14:10.339332+0000","last_became_peered":"2020-11-20T12:14:10.339332+0000","last_unstale":"2020-11-20T12:22:23.317304+0000","last_undegraded":"2020-11-20T12:22:23.317304+0000","last_fullsized":"2020-11-20T12:22:23.317304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":85,"num_read_kb":0,"num_write":1106,"num_write_kb":48894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.0","version":"26'12533","reported_seq":"12542","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.540341+0000","last_change":"2020-11-20T12:14:10.892096+0000","last_active":"2020-11-20T12:22:23.540341+0000","last_peered":"2020-11-20T12:22:23.540341+0000","last_clean":"2020-11-20T12:22:23.540341+0000","last_became_active":"2020-11-20T12:14:10.891647+0000","last_became_peered":"2020-11-20T12:14:10.891647+0000","last_unstale":"2020-11-20T12:22:23.540341+0000","last_undegraded":"2020-11-20T12:22:23.540341+0000","last_fullsized":"2020-11-20T12:22:23.540341+0000","mapping_epoch":24,"log_start":"26'2500","ondisk_log_start":"26'2500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10033,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13769,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'544","reported_seq":"581","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:24.914948+0000","last_change":"2020-11-20T12:14:10.339704+0000","last_active":"2020-11-20T12:22:24.914948+0000","last_peered":"2020-11-20T12:22:24.914948+0000","last_clean":"2020-11-20T12:22:24.914948+0000","last_became_active":"2020-11-20T12:14:10.339274+0000","last_became_peered":"2020-11-20T12:14:10.339274+0000","last_unstale":"2020-11-20T12:22:24.914948+0000","last_undegraded":"2020-11-20T12:22:24.914948+0000","last_fullsized":"2020-11-20T12:22:24.914948+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":544,"ondisk_log_size":544,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8671455,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":293,"num_write":839,"num_write_kb":32657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.881121+0000","last_change":"2020-11-20T12:14:06.894405+0000","last_active":"2020-11-20T12:14:10.881121+0000","last_peered":"2020-11-20T12:14:10.881121+0000","last_clean":"2020-11-20T12:14:10.881121+0000","last_became_active":"2020-11-20T12:14:06.894112+0000","last_became_peered":"2020-11-20T12:14:06.894112+0000","last_unstale":"2020-11-20T12:14:10.881121+0000","last_undegraded":"2020-11-20T12:14:10.881121+0000","last_fullsized":"2020-11-20T12:14:10.881121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'12311","reported_seq":"12320","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:23.559784+0000","last_change":"2020-11-20T12:14:11.293900+0000","last_active":"2020-11-20T12:22:23.559784+0000","last_peered":"2020-11-20T12:22:23.559784+0000","last_clean":"2020-11-20T12:22:23.559784+0000","last_became_active":"2020-11-20T12:14:11.293129+0000","last_became_peered":"2020-11-20T12:14:11.293129+0000","last_unstale":"2020-11-20T12:22:23.559784+0000","last_undegraded":"2020-11-20T12:22:23.559784+0000","last_fullsized":"2020-11-20T12:22:23.559784+0000","mapping_epoch":24,"log_start":"26'2300","ondisk_log_start":"26'2300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:10.318094+0000","last_clean_scrub_stamp":"2020-11-20T12:14:10.318094+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13536,"num_write_kb":82637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"13","reported_epoch":"25","state":"active+clean","last_fresh":"2020-11-20T12:14:10.892839+0000","last_change":"2020-11-20T12:14:06.894741+0000","last_active":"2020-11-20T12:14:10.892839+0000","last_peered":"2020-11-20T12:14:10.892839+0000","last_clean":"2020-11-20T12:14:10.892839+0000","last_became_active":"2020-11-20T12:14:06.894407+0000","last_became_peered":"2020-11-20T12:14:06.894407+0000","last_unstale":"2020-11-20T12:14:10.892839+0000","last_undegraded":"2020-11-20T12:14:10.892839+0000","last_fullsized":"2020-11-20T12:14:10.892839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:05.141692+0000","last_clean_scrub_stamp":"2020-11-20T12:14:05.141692+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"26'702","reported_seq":"712","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:24.916966+0000","last_change":"2020-11-20T12:14:10.532926+0000","last_active":"2020-11-20T12:22:24.916966+0000","last_peered":"2020-11-20T12:22:24.916966+0000","last_clean":"2020-11-20T12:22:24.916966+0000","last_became_active":"2020-11-20T12:14:10.532589+0000","last_became_peered":"2020-11-20T12:14:10.532589+0000","last_unstale":"2020-11-20T12:22:24.916966+0000","last_undegraded":"2020-11-20T12:22:24.916966+0000","last_fullsized":"2020-11-20T12:22:24.916966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:09.307066+0000","last_clean_scrub_stamp":"2020-11-20T12:14:09.307066+0000","log_size":702,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":1116,"num_write_kb":81138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107556,"num_write_kb":647856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80439,"ondisk_log_size":80439,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":217795658,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1318,"num_read_kb":4884,"num_write":8760,"num_write_kb":520461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6221,"ondisk_log_size":6221,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444138,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":846232,"kb_used_data":92853148,"kb_used_omap":16054,"kb_used_meta":0,"kb_avail":92853148,"statfs":{"total":95948165120,"available":95081623552,"internally_reserved":0,"allocated":95081623552,"data_stored":95081623552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16440058,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.244,"15min":1.5680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8859999999999999,"5min":4.7069999999999999,"15min":4.7460000000000004},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.4159999999999999,"15min":1.673},"min":{"1min":0.876,"5min":0.85999999999999999,"15min":0.82899999999999996},"max":{"1min":1.7929999999999999,"5min":4.7569999999999997,"15min":4.8070000000000004},"last":1.298}]},{"osd":1,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.083,"15min":1.1919999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.383,"5min":1.611,"15min":1.8560000000000001},"last":1.7370000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.1739999999999999,"15min":1.244},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3600000000000001,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.698}]},{"osd":2,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.94999999999999996,"15min":0.97299999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96099999999999997,"15min":0.96299999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3620000000000001,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.0149999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0629999999999999,"15min":1.2789999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.8740000000000001,"5min":3.1589999999999998,"15min":3.194},"last":1.504},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.512,"15min":1.6970000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.996,"5min":3.5099999999999998,"15min":6.4779999999999998},"last":1.6000000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2210000000000001,"15min":1.262},"min":{"1min":0.747,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.619,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.431},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0640000000000001,"15min":1.097},"min":{"1min":0.76200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.341,"5min":1.853,"15min":1.853},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3620000000000001,"15min":1.345},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8069999999999999,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.409,"15min":1.385},"min":{"1min":1.0009999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7889999999999999,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.571}]},{"osd":6,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.4810000000000001,"15min":1.6399999999999999},"min":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1869999999999998,"5min":10.239000000000001,"15min":10.239000000000001},"last":1.643},{"interface":"front","average":{"1min":1.641,"5min":1.804,"15min":1.921},"min":{"1min":1.3169999999999999,"5min":1.2649999999999999,"15min":1.2509999999999999},"max":{"1min":2.073,"5min":10.191000000000001,"15min":10.191000000000001},"last":1.8640000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.5900000000000001,"15min":1.635},"min":{"1min":1.097,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.0169999999999999,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.843},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.589,"15min":1.6439999999999999},"min":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":1.929,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":2.0800000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.282,"15min":1.3180000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.381},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.653,"15min":1.7290000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.1789999999999998,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.998}]},{"osd":10,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.677,"15min":1.706},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":2.1579999999999999,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.9670000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4179999999999999,"15min":1.4810000000000001},"min":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.0579999999999998,"5min":2.532,"15min":2.532},"last":1.776}]}]},{"osd":10,"up_from":17,"seq":73014444137,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":869576,"kb_used_data":92829812,"kb_used_omap":21603,"kb_used_meta":0,"kb_avail":92829804,"statfs":{"total":95948165120,"available":95057719296,"internally_reserved":8192,"allocated":95057727488,"data_stored":95057727488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22121595,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.599,"15min":1.8240000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.69499999999999995},"max":{"1min":3.419,"5min":32.482999999999997,"15min":39.473999999999997},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.48,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":4.6379999999999999,"5min":32.982999999999997,"15min":239.38800000000001},"last":1.665}]},{"osd":1,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.93000000000000005,"15min":1.0289999999999999},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4630000000000001,"5min":6.4720000000000004,"15min":39.573},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.88700000000000001},"min":{"1min":0.629,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1579999999999999,"5min":1.407,"15min":2.0870000000000002},"last":0.97199999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0600000000000001,"15min":1.083},"min":{"1min":0.68700000000000006,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.127},{"interface":"front","average":{"1min":1.252,"5min":1.367,"15min":1.468},"min":{"1min":0.93999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0419999999999998,"5min":6.7140000000000004,"15min":38.835000000000001},"last":1.4950000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3959999999999999,"15min":1.667},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":4.125,"5min":4.5640000000000001,"15min":7.9409999999999998},"last":1.421},{"interface":"front","average":{"1min":1.399,"5min":1.47,"15min":1.752},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.80800000000000005},"max":{"1min":2.738,"5min":4.4829999999999997,"15min":8.6170000000000009},"last":1.5389999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.339,"15min":1.444},"min":{"1min":0.81000000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.2109999999999999,"5min":6.9589999999999996,"15min":38.975000000000001},"last":1.26},{"interface":"front","average":{"1min":1.202,"5min":1.214,"15min":1.2470000000000001},"min":{"1min":0.92300000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.6499999999999999,"5min":2.2389999999999999,"15min":3.7450000000000001},"last":1.29}]},{"osd":5,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5129999999999999,"15min":1.899},"min":{"1min":1.0840000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.153,"5min":7.2629999999999999,"15min":39.110999999999997},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3540000000000001,"15min":1.4450000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.7649999999999999,"5min":2.0169999999999999,"15min":3.3410000000000002},"last":1.524}]},{"osd":6,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.946,"15min":2.694},"min":{"1min":1.2090000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.8660000000000001,"5min":33.418999999999997,"15min":200.03700000000001},"last":1.24},{"interface":"front","average":{"1min":1.619,"5min":2.1070000000000002,"15min":2.3220000000000001},"min":{"1min":1.2450000000000001,"5min":1.204,"15min":1.204},"max":{"1min":2.278,"5min":32.927,"15min":39.350999999999999},"last":1.7010000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.526,"15min":1.7829999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":2.0099999999999998,"5min":3.6360000000000001,"15min":8.1379999999999999},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.7},"min":{"1min":0.95899999999999996,"5min":0.876,"15min":0.77700000000000002},"max":{"1min":2.6160000000000001,"5min":3.3100000000000001,"15min":8.7789999999999999},"last":1.3360000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.782,"5min":2.2120000000000002,"15min":2.46},"min":{"1min":1.4379999999999999,"5min":1.268,"15min":1.268},"max":{"1min":3.1070000000000002,"5min":29.462,"15min":29.462},"last":1.8089999999999999},{"interface":"front","average":{"1min":1.702,"5min":2.2799999999999998,"15min":2.5270000000000001},"min":{"1min":1.268,"5min":1.268,"15min":1.268},"max":{"1min":2.4710000000000001,"5min":29.373999999999999,"15min":39.234000000000002},"last":2.2320000000000002}]},{"osd":11,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.5660000000000001,"15min":1.8640000000000001},"min":{"1min":1.2609999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.1269999999999998,"5min":2.2429999999999999,"15min":7.7889999999999997},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.681,"5min":1.6519999999999999,"15min":1.8979999999999999},"min":{"1min":1.224,"5min":1.091,"15min":1.091},"max":{"1min":2.984,"5min":3.4420000000000002,"15min":8.9450000000000003},"last":1.448}]}]},{"osd":9,"up_from":17,"seq":73014444137,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":838160,"kb_used_data":92861228,"kb_used_omap":16874,"kb_used_meta":0,"kb_avail":92861220,"statfs":{"total":95948165120,"available":95089889280,"internally_reserved":8192,"allocated":95089897472,"data_stored":95089897472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17279644,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":3.4889999999999999,"15min":3.375},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":5.9969999999999999,"5min":13.090999999999999,"15min":18.306000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":3.3279999999999998,"5min":24.893000000000001,"15min":10.641999999999999},"min":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":24.001000000000001,"5min":935.75699999999995,"15min":935.75699999999995},"last":2.302}]},{"osd":1,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.077,"5min":12.826000000000001,"15min":6.0579999999999998},"min":{"1min":0.90800000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":23.058,"5min":535.80399999999997,"15min":535.80399999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.907,"15min":2.4300000000000002},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.4609999999999999,"5min":6.7619999999999996,"15min":18.015999999999998},"last":1.161}]},{"osd":2,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.3319999999999999,"5min":13.041,"15min":6.601},"min":{"1min":0.88800000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":23.382000000000001,"5min":535.95100000000002,"15min":535.95100000000002},"last":1.052},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.1469999999999998,"15min":2.5779999999999998},"min":{"1min":0.79000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.7709999999999999,"5min":6.6600000000000001,"15min":13.66},"last":2.8929999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.419,"5min":3.7469999999999999,"15min":3.8900000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":4.8609999999999998,"5min":13.281000000000001,"15min":14.066000000000001},"last":3.6019999999999999},{"interface":"front","average":{"1min":2.6469999999999998,"5min":3.8929999999999998,"15min":4.3680000000000003},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":7.0049999999999999,"5min":12.503,"15min":18.175999999999998},"last":3.3879999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":13.481999999999999,"15min":7.3499999999999996},"min":{"1min":1.1779999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":23.251999999999999,"5min":556.02599999999995,"15min":556.02599999999995},"last":1.3839999999999999},{"interface":"front","average":{"1min":2.1589999999999998,"5min":2.5870000000000002,"15min":3.4820000000000002},"min":{"1min":1.1120000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":4.931,"5min":18.196000000000002,"15min":18.196000000000002},"last":3.2210000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.319,"15min":3.524},"min":{"1min":1.399,"5min":1.175,"15min":1.175},"max":{"1min":6.5700000000000003,"5min":7.1479999999999997,"15min":18.446000000000002},"last":2.383},{"interface":"front","average":{"1min":2.2999999999999998,"5min":2.6930000000000001,"15min":3.927},"min":{"1min":1.2270000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":5.0030000000000001,"5min":8.8900000000000006,"15min":19.318000000000001},"last":3.456}]},{"osd":6,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":4.444,"15min":5.4000000000000004},"min":{"1min":1.708,"5min":1.48,"15min":1.48},"max":{"1min":12.815,"5min":17.027000000000001,"15min":24.981000000000002},"last":2.8239999999999998},{"interface":"front","average":{"1min":4.5549999999999997,"5min":15.795,"15min":9.0790000000000006},"min":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":23.866,"5min":589.55999999999995,"15min":589.55999999999995},"last":2.1669999999999998}]},{"osd":8,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.4950000000000001,"5min":2.5339999999999998,"15min":4.1159999999999997},"min":{"1min":1.5780000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"max":{"1min":6.7169999999999996,"5min":7.5510000000000002,"15min":18.579000000000001},"last":2.5310000000000001},{"interface":"front","average":{"1min":4.1360000000000001,"5min":13.949,"15min":7.7789999999999999},"min":{"1min":1.5449999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":23.529,"5min":561.18200000000002,"15min":561.18200000000002},"last":1.5760000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":3.0659999999999998,"15min":4.2679999999999998},"min":{"1min":1.369,"5min":1.286,"15min":1.286},"max":{"1min":9.2100000000000009,"5min":9.2100000000000009,"15min":19.547999999999998},"last":3.7349999999999999},{"interface":"front","average":{"1min":2.6659999999999999,"5min":2.6699999999999999,"15min":4.3769999999999998},"min":{"1min":1.8160000000000001,"5min":1.46,"15min":1.46},"max":{"1min":6.8659999999999997,"5min":7.6769999999999996,"15min":18.707000000000001},"last":2.6789999999999998}]},{"osd":11,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":4.2939999999999996,"5min":14.108000000000001,"15min":8.0500000000000007},"min":{"1min":1.7949999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"max":{"1min":23.658999999999999,"5min":561.32899999999995,"15min":561.32899999999995},"last":2.0329999999999999},{"interface":"front","average":{"1min":2.609,"5min":3.1269999999999998,"15min":4.5359999999999996},"min":{"1min":1.5469999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"max":{"1min":5.181,"5min":12.641,"15min":19.780000000000001},"last":3.8769999999999998}]}]},{"osd":8,"up_from":17,"seq":73014444139,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":837264,"kb_used_data":92862120,"kb_used_omap":10843,"kb_used_meta":0,"kb_avail":92862116,"statfs":{"total":95948165120,"available":95090806784,"internally_reserved":4096,"allocated":95090810880,"data_stored":95090810880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11103552,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7689999999999999,"5min":1.377,"15min":2.2229999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":19.047999999999998,"5min":19.047999999999998,"15min":197.74100000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.5109999999999999,"15min":2.4260000000000002},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":19.082999999999998,"5min":19.082999999999998,"15min":197.762},"last":1.0860000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.427,"15min":1.538},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1359999999999999,"5min":1.748,"15min":1.748},"last":1.3680000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77700000000000002,"15min":0.85999999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1539999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.98099999999999998,"15min":1.0229999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3859999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0389999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.29,"15min":1.5109999999999999},"min":{"1min":0.73399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"max":{"1min":5.8419999999999996,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":1.266},{"interface":"front","average":{"1min":1.5,"5min":1.385,"15min":1.74},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":5.8940000000000001,"5min":5.8940000000000001,"15min":5.8940000000000001},"last":1.5009999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.997,"15min":1.1479999999999999},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3300000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.343},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2709999999999999,"15min":1.339},"min":{"1min":0.88800000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6559999999999999,"5min":1.764,"15min":1.764},"last":1.4690000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.4870000000000001,"15min":2.758},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82199999999999995},"max":{"1min":2.5750000000000002,"5min":5.7619999999999996,"15min":278.42200000000003},"last":1.294},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.5860000000000001,"15min":2.8290000000000002},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.6619999999999999,"5min":5.8120000000000003,"15min":278.48700000000002},"last":1.4339999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.264,"15min":1.278},"min":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.79400000000000004},"max":{"1min":1.9139999999999999,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":1.119},{"interface":"front","average":{"1min":1.304,"5min":1.3720000000000001,"15min":1.407},"min":{"1min":0.95599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8120000000000001,"5min":3.3490000000000002,"15min":3.3490000000000002},"last":1.202}]},{"osd":9,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.671,"15min":4.7080000000000002},"min":{"1min":1.089,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.3100000000000001,"5min":5.7140000000000004,"15min":620.09000000000003},"last":1.528},{"interface":"front","average":{"1min":1.508,"5min":1.7709999999999999,"15min":1.827},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":3.1200000000000001,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":1.641}]},{"osd":10,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4870000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.827,"5min":1.9119999999999999,"15min":3.367},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3480000000000001,"15min":1.458},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.6299999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":1.228}]},{"osd":11,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.4510000000000001,"15min":1.5309999999999999},"min":{"1min":1.008,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.845,"5min":1.9530000000000001,"15min":2.2389999999999999},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.405,"5min":1.4550000000000001,"15min":1.5640000000000001},"min":{"1min":1.024,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.956,"5min":1.984,"15min":1.984},"last":1.5920000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444138,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":835160,"kb_used_data":92864220,"kb_used_omap":17970,"kb_used_meta":0,"kb_avail":92864220,"statfs":{"total":95948165120,"available":95092961280,"internally_reserved":0,"allocated":95092961280,"data_stored":95092961280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18401771,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.98399999999999999,"15min":1.232},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0369999999999999,"5min":3.6760000000000002,"15min":4.8239999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3779999999999999,"15min":1.494},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.7770000000000001,"5min":5.165,"15min":27.524999999999999},"last":1.2989999999999999}]},{"osd":1,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.58899999999999997,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":1.038,"15min":1.121},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.83399999999999996,"15min":0.871},"min":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.59499999999999997},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.98699999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.01,"15min":0.996},"min":{"1min":0.69099999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.4850000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0429999999999999,"15min":1.1299999999999999},"min":{"1min":0.755,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.482,"5min":1.615,"15min":1.615},"last":1.254}]},{"osd":3,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.548},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.74199999999999999},"max":{"1min":2.0600000000000001,"5min":5.0149999999999997,"15min":5.0149999999999997},"last":1.45},{"interface":"front","average":{"1min":1.335,"5min":1.3200000000000001,"15min":1.468},"min":{"1min":0.91700000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.2240000000000002,"5min":3.254,"15min":3.254},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.163,"15min":1.228},"min":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.571,"5min":1.744,"15min":1.744},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":1.0389999999999999,"5min":0.85899999999999999,"15min":0.81100000000000005},"max":{"1min":1.8129999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.5980000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5049999999999999,"15min":1.706},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.85799999999999998},"max":{"1min":2.4020000000000001,"5min":4.54,"15min":13.116},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.677,"15min":1.917},"min":{"1min":1.0940000000000001,"5min":0.871,"15min":0.871},"max":{"1min":3.9020000000000001,"5min":13.208,"15min":26.581},"last":1.514}]},{"osd":8,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.429,"15min":1.4790000000000001},"min":{"1min":1.1759999999999999,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":2.069,"5min":2.1539999999999999,"15min":2.1709999999999998},"last":1.776},{"interface":"front","average":{"1min":1.498,"5min":1.417,"15min":1.4299999999999999},"min":{"1min":0.98799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.0070000000000001,"5min":2.04,"15min":2.1309999999999998},"last":1.9590000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.8009999999999999,"15min":2.2839999999999998},"min":{"1min":1.22,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.849,"5min":4.9180000000000001,"15min":71.325999999999993},"last":1.736},{"interface":"front","average":{"1min":1.708,"5min":1.9179999999999999,"15min":2.3610000000000002},"min":{"1min":1.4219999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":2.2949999999999999,"5min":4.9429999999999996,"15min":69.656999999999996},"last":2.0510000000000002}]},{"osd":10,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.458,"15min":1.5},"min":{"1min":1.0009999999999999,"5min":0.99199999999999999,"15min":0.78100000000000003},"max":{"1min":2.2709999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.8240000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.4139999999999999,"15min":1.476},"min":{"1min":1.127,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.9510000000000001,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.649}]},{"osd":11,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.544,"15min":1.643},"min":{"1min":1.2290000000000001,"5min":1.125,"15min":0.97099999999999997},"max":{"1min":2.181,"5min":2.371,"15min":2.7469999999999999},"last":1.9159999999999999},{"interface":"front","average":{"1min":1.611,"5min":1.5620000000000001,"15min":1.6419999999999999},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":0.92600000000000005},"max":{"1min":2.1509999999999998,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":2.081}]}]},{"osd":6,"up_from":17,"seq":73014444137,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":847284,"kb_used_data":92852096,"kb_used_omap":21321,"kb_used_meta":0,"kb_avail":92852096,"statfs":{"total":95948165120,"available":95080546304,"internally_reserved":0,"allocated":95080546304,"data_stored":95080546304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21833369,"internal_metadata":0},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":3.0150000000000001,"15min":2.8370000000000002},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8839999999999999,"5min":11.977,"15min":55.573999999999998},"last":2.3199999999999998},{"interface":"front","average":{"1min":2.0169999999999999,"5min":3.988,"15min":4.0449999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":5.7679999999999998,"5min":66.028999999999996,"15min":147.11099999999999},"last":2.2810000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":2.5640000000000001,"15min":2.964},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.4379999999999997,"5min":52.729999999999997,"15min":106.60899999999999},"last":3.5049999999999999},{"interface":"front","average":{"1min":1.9850000000000001,"5min":2.1320000000000001,"15min":3.0459999999999998},"min":{"1min":0.77100000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":5.1500000000000004,"5min":15.574999999999999,"15min":104.149},"last":2.3929999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.1669999999999998,"5min":2.899,"15min":3.4159999999999999},"min":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.742,"5min":65.375,"15min":106.741},"last":3.9689999999999999},{"interface":"front","average":{"1min":2.4950000000000001,"5min":2.4049999999999998,"15min":3.5110000000000001},"min":{"1min":1.018,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":6.1790000000000003,"5min":15.702999999999999,"15min":104.271},"last":3.4670000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8340000000000001,"5min":3.6699999999999999,"15min":4.3979999999999997},"min":{"1min":1.3300000000000001,"5min":0.97699999999999998,"15min":0.81799999999999995},"max":{"1min":6.577,"5min":15.83,"15min":104.387},"last":4.0960000000000001},{"interface":"front","average":{"1min":2.2320000000000002,"5min":3.4670000000000001,"15min":3.6509999999999998},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":5.5469999999999997,"5min":8.0630000000000006,"15min":55.439999999999998},"last":3.0569999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.0350000000000001,"5min":2.4449999999999998,"15min":3.1139999999999999},"min":{"1min":1.1759999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":4.1139999999999999,"5min":9.1310000000000002,"15min":55.796999999999997},"last":3.6099999999999999},{"interface":"front","average":{"1min":2.419,"5min":3.2970000000000002,"15min":4.008},"min":{"1min":1.1020000000000001,"5min":1.0349999999999999,"15min":1.0249999999999999},"max":{"1min":4.6189999999999998,"5min":65.503,"15min":106.861},"last":4.3979999999999997}]},{"osd":7,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.9220000000000002,"5min":2.7130000000000001,"15min":4.1859999999999999},"min":{"1min":1.5309999999999999,"5min":1.0469999999999999,"15min":0.81399999999999995},"max":{"1min":6.3940000000000001,"5min":16.32,"15min":113.36799999999999},"last":3.5840000000000001},{"interface":"front","average":{"1min":2.2250000000000001,"5min":2.5110000000000001,"15min":3.3540000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":4.4950000000000001,"5min":8.202,"15min":55.915999999999997},"last":3.7909999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6360000000000001,"5min":3.5190000000000001,"15min":4.6059999999999999},"min":{"1min":1.3640000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":4.8659999999999997,"5min":65.617000000000004,"15min":107.164},"last":4.798},{"interface":"front","average":{"1min":3.0880000000000001,"5min":3.0150000000000001,"15min":4.5259999999999998},"min":{"1min":1.4059999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":7.0090000000000003,"5min":16.451000000000001,"15min":113.634},"last":3.673}]},{"osd":9,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":5.0439999999999996,"15min":6.9560000000000004},"min":{"1min":1.526,"5min":1.526,"15min":1.526},"max":{"1min":5.8920000000000003,"5min":83.903000000000006,"15min":466.512},"last":4.2290000000000001},{"interface":"front","average":{"1min":3.0289999999999999,"5min":5.1369999999999996,"15min":5.7519999999999998},"min":{"1min":1.498,"5min":1.498,"15min":1.498},"max":{"1min":5.0010000000000003,"5min":65.837999999999994,"15min":107.398},"last":5.1779999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":3.302,"5min":3.4569999999999999,"15min":4.8300000000000001},"min":{"1min":1.7689999999999999,"5min":1.383,"15min":1.2330000000000001},"max":{"1min":6.7720000000000002,"5min":36.499000000000002,"15min":113.506},"last":3.9420000000000002},{"interface":"front","average":{"1min":2.5510000000000002,"5min":2.7989999999999999,"15min":3.8330000000000002},"min":{"1min":1.452,"5min":1.224,"15min":1.224},"max":{"1min":5.218,"5min":8.9109999999999996,"15min":56.043999999999997},"last":4.0549999999999997}]},{"osd":11,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8340000000000001,"5min":3.6269999999999998,"15min":4.9589999999999996},"min":{"1min":1.7529999999999999,"5min":1.425,"15min":1.425},"max":{"1min":5.1470000000000002,"5min":65.727999999999994,"15min":107.282},"last":5.5499999999999998},{"interface":"front","average":{"1min":3.423,"5min":3.569,"15min":5.0519999999999996},"min":{"1min":1.8200000000000001,"5min":1.411,"15min":1.411},"max":{"1min":7.2409999999999997,"5min":36.649000000000001,"15min":113.756},"last":3.8460000000000001}]}]},{"osd":1,"up_from":17,"seq":73014444138,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796424,"kb_used_data":92902956,"kb_used_omap":6345,"kb_used_meta":0,"kb_avail":92902956,"statfs":{"total":95948165120,"available":95132626944,"internally_reserved":0,"allocated":95132626944,"data_stored":95132626944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6498008,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.5429999999999999,"15min":2.6240000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.0600000000000001,"5min":30.274999999999999,"15min":283.54199999999997},"last":10.244},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.673,"15min":2.6739999999999999},"min":{"1min":0.83599999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.992,"5min":30.335000000000001,"15min":283.51499999999999},"last":10.441000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.02,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.335,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.93000000000000005,"15min":0.98899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.393,"5min":2.149,"15min":2.149},"last":0.77300000000000002}]},{"osd":3,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.375,"15min":1.6419999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5820000000000001,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4690000000000001,"15min":1.6839999999999999},"min":{"1min":1,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.085,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":1.198}]},{"osd":4,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0269999999999999,"15min":1.075},"min":{"1min":0.76700000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4610000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.083},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.78200000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.512,"5min":8.7349999999999994,"15min":8.7349999999999994},"last":1.0469999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1140000000000001,"5min":4.4779999999999998,"15min":4.4779999999999998},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.4059999999999999,"15min":1.431},"min":{"1min":0.97899999999999998,"5min":0.93400000000000005,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.415}]},{"osd":6,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":4.8630000000000004,"15min":2.839},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.86599999999999999},"max":{"1min":7.0330000000000004,"5min":280.65300000000002,"15min":280.65300000000002},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.6359999999999999,"15min":1.603},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.984,"5min":13.917999999999999,"15min":13.917999999999999},"last":1.5840000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4630000000000001,"15min":1.4450000000000001},"min":{"1min":0.91100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1419999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.85099999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7809999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.464}]},{"osd":8,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1879999999999999,"15min":1.2290000000000001},"min":{"1min":0.78900000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.3919999999999999,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5900000000000001,"15min":1.629},"min":{"1min":1.046,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8220000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.659}]},{"osd":9,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.6990000000000001,"15min":1.8080000000000001},"min":{"1min":1.228,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.3759999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.901,"5min":8.3670000000000009,"15min":6.7709999999999999},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":5.2939999999999996,"5min":500.98700000000002,"15min":743.49599999999998},"last":1.75}]},{"osd":11,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.5609999999999999,"15min":1.5660000000000001},"min":{"1min":1.1000000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":1.7549999999999999,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.389,"15min":1.468},"min":{"1min":1.0489999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.3660000000000001,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.246}]}]},{"osd":0,"up_from":17,"seq":73014444137,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797356,"kb_used_data":92902024,"kb_used_omap":12634,"kb_used_meta":0,"kb_avail":92902024,"statfs":{"total":95948165120,"available":95131672576,"internally_reserved":0,"allocated":95131672576,"data_stored":95131672576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12937721,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":4.6180000000000003,"15min":2.9340000000000002},"min":{"1min":0.749,"5min":0.747,"15min":0.747},"max":{"1min":3.6989999999999998,"5min":160.18899999999999,"15min":160.18899999999999},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.893,"5min":1.952,"15min":2.0169999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.9569999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":1.2769999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":2.3090000000000002,"15min":2.2360000000000002},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.54,"5min":61.881999999999998,"15min":61.881999999999998},"last":1.365},{"interface":"front","average":{"1min":2.5289999999999999,"5min":5.0670000000000002,"15min":4.6760000000000002},"min":{"1min":1.1699999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":4.4809999999999999,"5min":160.33099999999999,"15min":272.47399999999999},"last":1.8380000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7759999999999998,"5min":5.6790000000000003,"15min":5.3259999999999996},"min":{"1min":1.5289999999999999,"5min":0.94299999999999995,"15min":0.93100000000000005},"max":{"1min":4.2160000000000002,"5min":160.45599999999999,"15min":272.67399999999998},"last":1.6919999999999999},{"interface":"front","average":{"1min":2.355,"5min":3.5009999999999999,"15min":3.504},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":4.6989999999999998,"5min":62.017000000000003,"15min":62.017000000000003},"last":2.0840000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9089999999999998,"5min":5.226,"15min":5.1689999999999996},"min":{"1min":1.3540000000000001,"5min":1.0840000000000001,"15min":1.0620000000000001},"max":{"1min":4.6680000000000001,"5min":160.58099999999999,"15min":272.84399999999999},"last":1.974},{"interface":"front","average":{"1min":2.4239999999999999,"5min":2.2480000000000002,"15min":3.6139999999999999},"min":{"1min":1.204,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":4.3029999999999999,"5min":6.6749999999999998,"15min":265.32100000000003},"last":1.7350000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":2.8650000000000002,"15min":4.3259999999999996},"min":{"1min":1.083,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":4.8449999999999998,"5min":62.151000000000003,"15min":267.30000000000001},"last":1.877},{"interface":"front","average":{"1min":3.069,"5min":5.6040000000000001,"15min":5.5529999999999999},"min":{"1min":1.496,"5min":1.2270000000000001,"15min":1.2270000000000001},"max":{"1min":5.1159999999999997,"5min":178.53999999999999,"15min":273.16199999999998},"last":2.1499999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.3239999999999998,"5min":3.4380000000000002,"15min":4.6260000000000003},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":6.1829999999999998,"5min":10.782999999999999,"15min":266.46699999999998},"last":1.9179999999999999},{"interface":"front","average":{"1min":3.0920000000000001,"5min":6.827,"15min":6.2300000000000004},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":5.524,"5min":219.703,"15min":266.62599999999998},"last":2.3260000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.2549999999999999,"5min":5.8170000000000002,"15min":5.7709999999999999},"min":{"1min":1.6839999999999999,"5min":1.5229999999999999,"15min":1.3180000000000001},"max":{"1min":5.4619999999999997,"5min":178.80699999999999,"15min":273.00400000000002},"last":2.2890000000000001},{"interface":"front","average":{"1min":2.6890000000000001,"5min":2.5299999999999998,"15min":4.0739999999999998},"min":{"1min":1.452,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":4.3360000000000003,"5min":5.5590000000000002,"15min":266.05900000000003},"last":2.1259999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.8100000000000001,"5min":3.1720000000000002,"15min":4.7800000000000002},"min":{"1min":1.3859999999999999,"5min":1.137,"15min":1.137},"max":{"1min":5.1239999999999997,"5min":62.274999999999999,"15min":267.91699999999997},"last":2.5430000000000001},{"interface":"front","average":{"1min":3.4510000000000001,"5min":6.0700000000000003,"15min":6.0590000000000002},"min":{"1min":1.8440000000000001,"5min":1.6359999999999999,"15min":1.5880000000000001},"max":{"1min":5.6970000000000001,"5min":178.68000000000001,"15min":273.33199999999999},"last":2.4129999999999998}]},{"osd":10,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7599999999999998,"5min":2.661,"15min":4.3090000000000002},"min":{"1min":1.575,"5min":1.3660000000000001,"15min":1.3660000000000001},"max":{"1min":4.4400000000000004,"5min":5.6900000000000004,"15min":265.68799999999999},"last":2.024},{"interface":"front","average":{"1min":3.0379999999999998,"5min":3.327,"15min":5.0090000000000003},"min":{"1min":1.53,"5min":1.4330000000000001,"15min":1.4330000000000001},"max":{"1min":5.8220000000000001,"5min":62.399000000000001,"15min":267.00299999999999},"last":2.7509999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.556,"5min":6.2549999999999999,"15min":6.3010000000000002},"min":{"1min":1.9870000000000001,"5min":1.76,"15min":1.712},"max":{"1min":5.8940000000000001,"5min":178.94300000000001,"15min":273.65899999999999},"last":2.5899999999999999},{"interface":"front","average":{"1min":3.157,"5min":3.4689999999999999,"15min":5.2430000000000003},"min":{"1min":1.6220000000000001,"5min":1.403,"15min":1.403},"max":{"1min":6.202,"5min":62.533999999999999,"15min":267.61099999999999},"last":2.9550000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444137,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796556,"kb_used_data":92902824,"kb_used_omap":6357,"kb_used_meta":0,"kb_avail":92902824,"statfs":{"total":95948165120,"available":95132491776,"internally_reserved":0,"allocated":95132491776,"data_stored":95132491776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6509896,"internal_metadata":0},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.88800000000000001},"min":{"1min":0.626,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2749999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.91500000000000004,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2310000000000001,"5min":1.764,"15min":1.764},"last":0.97099999999999997}]},{"osd":3,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1699999999999999,"15min":1.4690000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.552,"5min":6.1600000000000001,"15min":6.9889999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.23,"15min":1.528},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.548,"5min":3.6099999999999999,"15min":7.2889999999999997},"last":1.5209999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.93899999999999995,"15min":1.1399999999999999},"min":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0860000000000001,"5min":1.4510000000000001,"15min":6.867},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.093,"15min":1.1399999999999999},"min":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.917,"15min":1.917},"last":1.24}]},{"osd":5,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95499999999999996,"15min":0.98399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.381,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.29},{"interface":"front","average":{"1min":1.079,"5min":1.0489999999999999,"15min":1.1890000000000001},"min":{"1min":0.72799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":6.7140000000000004},"last":1.3280000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":3.302,"15min":2.3639999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8049999999999999,"5min":122.973,"15min":122.973},"last":1.98},{"interface":"front","average":{"1min":1.417,"5min":1.5669999999999999,"15min":1.6910000000000001},"min":{"1min":0.94699999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":3.105,"5min":12.023999999999999,"15min":12.023999999999999},"last":1.6399999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3340000000000001},"min":{"1min":1.0249999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.391},{"interface":"front","average":{"1min":1.288,"5min":1.335,"15min":1.329},"min":{"1min":1.002,"5min":0.872,"15min":0.84599999999999997},"max":{"1min":2.1720000000000002,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.4359999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3759999999999999,"15min":1.415},"min":{"1min":0.91500000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.806,"5min":2.302,"15min":2.302},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.458},"min":{"1min":1.0389999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8169999999999999,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.571}]},{"osd":9,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.8959999999999999,"5min":7.1989999999999998,"15min":5.1559999999999997},"min":{"1min":1.2350000000000001,"5min":1.087,"15min":1.087},"max":{"1min":6.1680000000000001,"5min":378.10700000000003,"15min":378.10700000000003},"last":1.7789999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":7.2750000000000004,"15min":5.3019999999999996},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":6.1189999999999998,"5min":378.18599999999998,"15min":378.18599999999998},"last":1.8799999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.593,"15min":1.7629999999999999},"min":{"1min":1.121,"5min":1.1200000000000001,"15min":1.1200000000000001},"max":{"1min":1.948,"5min":4.8609999999999998,"15min":6.8940000000000001},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5269999999999999,"15min":1.677},"min":{"1min":1.161,"5min":1.04,"15min":0.99099999999999999},"max":{"1min":2.1389999999999998,"5min":4.8399999999999999,"15min":7.9790000000000001},"last":1.4690000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.609,"15min":1.794},"min":{"1min":1.236,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.3130000000000002,"5min":2.4220000000000002,"15min":6.9619999999999997},"last":1.8},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.6319999999999999,"15min":1.679},"min":{"1min":1.264,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.847}]}]},{"osd":3,"up_from":17,"seq":73014444137,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":858476,"kb_used_data":92840904,"kb_used_omap":8912,"kb_used_meta":0,"kb_avail":92840904,"statfs":{"total":95948165120,"available":95069085696,"internally_reserved":0,"allocated":95069085696,"data_stored":95069085696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9126545,"internal_metadata":0},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":2.1059999999999999,"15min":2.012},"min":{"1min":0.78700000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.552,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":1.621},{"interface":"front","average":{"1min":2.0230000000000001,"5min":2.4620000000000002,"15min":2.1589999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.694,"5min":6.9100000000000001,"15min":6.9100000000000001},"last":1.992}]},{"osd":2,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.6220000000000001,"15min":1.9910000000000001},"min":{"1min":0.83199999999999996,"5min":0.745,"15min":0.745},"max":{"1min":4.2759999999999998,"5min":5.4539999999999997,"15min":5.7859999999999996},"last":1.5109999999999999},{"interface":"front","average":{"1min":2.3069999999999999,"5min":2.2570000000000001,"15min":2.847},"min":{"1min":1.4239999999999999,"5min":0.879,"15min":0.879},"max":{"1min":4.0759999999999996,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":2.077}]},{"osd":4,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":2.7429999999999999,"15min":2.827},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.91900000000000004},"max":{"1min":3.6869999999999998,"5min":7.2699999999999996,"15min":7.2699999999999996},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.8009999999999999,"15min":2.3260000000000001},"min":{"1min":1.0069999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.9189999999999996},"last":1.9370000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6659999999999999,"5min":2.5630000000000002,"15min":3.2599999999999998},"min":{"1min":1.6619999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.407,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":3.5150000000000001},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.9670000000000001,"15min":3.2629999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":4.5839999999999996,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":2.173}]},{"osd":6,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":4.2519999999999998,"15min":3.9100000000000001},"min":{"1min":1.214,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":5.1479999999999997,"5min":44.954000000000001,"15min":44.954000000000001},"last":2.7890000000000001},{"interface":"front","average":{"1min":3.2869999999999999,"5min":4.6079999999999997,"15min":4.4809999999999999},"min":{"1min":1.9119999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":5.891,"5min":23.939,"15min":23.939},"last":4.3639999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":3.2149999999999999,"15min":3.5219999999999998},"min":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.429},"max":{"1min":4.2679999999999998,"5min":8.7919999999999998,"15min":8.7919999999999998},"last":2.2959999999999998},{"interface":"front","average":{"1min":2.4129999999999998,"5min":2.2269999999999999,"15min":3.0209999999999999},"min":{"1min":1.3939999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":5.2800000000000002,"5min":5.5839999999999996,"15min":5.5839999999999996},"last":2.4849999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":2.7890000000000001,"15min":3.633},"min":{"1min":1.97,"5min":1.49,"15min":1.49},"max":{"1min":5.1580000000000004,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":3.7959999999999998},{"interface":"front","average":{"1min":3.0489999999999999,"5min":3.3149999999999999,"15min":3.7069999999999999},"min":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"max":{"1min":5.1150000000000002,"5min":8.6669999999999998,"15min":8.6669999999999998},"last":2.415}]},{"osd":9,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.6520000000000001,"5min":4.7000000000000002,"15min":4.891},"min":{"1min":2.274,"5min":1.9910000000000001,"15min":1.9910000000000001},"max":{"1min":6.3220000000000001,"5min":14.824999999999999,"15min":14.824999999999999},"last":3.9889999999999999},{"interface":"front","average":{"1min":3.8820000000000001,"5min":4.7560000000000002,"15min":4.6689999999999996},"min":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"max":{"1min":6.1459999999999999,"5min":12.275,"15min":12.275},"last":2.7509999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.194,"5min":2.9900000000000002,"15min":3.988},"min":{"1min":2.0209999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"max":{"1min":5.9359999999999999,"5min":7.5350000000000001,"15min":7.5350000000000001},"last":4.1790000000000003},{"interface":"front","average":{"1min":2.5209999999999999,"5min":2.2629999999999999,"15min":3.1749999999999998},"min":{"1min":1.387,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":5.4320000000000004,"5min":5.5309999999999997,"15min":6.1890000000000001},"last":2.6379999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":3.5009999999999999,"15min":4.077},"min":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"max":{"1min":5.3310000000000004,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":2.532},{"interface":"front","average":{"1min":3.3410000000000002,"5min":3.109,"15min":4.2320000000000002},"min":{"1min":2.226,"5min":1.6319999999999999,"15min":1.6319999999999999},"max":{"1min":6.3250000000000002,"5min":7.4130000000000003,"15min":7.4130000000000003},"last":4.5499999999999998}]}]},{"osd":4,"up_from":17,"seq":73014444139,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":913800,"kb_used_data":92785584,"kb_used_omap":32337,"kb_used_meta":0,"kb_avail":92785580,"statfs":{"total":95948165120,"available":95012433920,"internally_reserved":4096,"allocated":95012438016,"data_stored":95012438016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33113817,"internal_metadata":0},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.716,"15min":1.5760000000000001},"min":{"1min":0.68500000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9039999999999999,"5min":38.838000000000001,"15min":38.838000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.329,"5min":1.2569999999999999,"15min":1.6100000000000001},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.6619999999999999,"5min":5.6539999999999999,"15min":8.3780000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84199999999999997,"15min":0.90800000000000003},"min":{"1min":0.66100000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.077,"5min":1.038,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.628,"15min":0.628},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.3120000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2689999999999999,"15min":1.546},"min":{"1min":0.71399999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0219999999999998,"5min":4.298,"15min":4.298},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.258,"15min":1.871},"min":{"1min":0.86199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.226,"5min":3.5880000000000001,"15min":8.8209999999999997},"last":1.1419999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.145,"15min":1.2470000000000001},"min":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.573,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.171},{"interface":"front","average":{"1min":1.038,"5min":1.109,"15min":1.1140000000000001},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.897,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.2090000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.498,"15min":1.5449999999999999},"min":{"1min":0.85799999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.274,"5min":4.1840000000000002,"15min":5.4100000000000001},"last":1.345},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.7410000000000001,"15min":1.8939999999999999},"min":{"1min":0.95399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.923,"5min":21.384,"15min":21.384},"last":1.012}]},{"osd":7,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3180000000000001,"15min":1.3440000000000001},"min":{"1min":1.038,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0609999999999999,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.53},"min":{"1min":0.76600000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.141,"5min":4.4390000000000001,"15min":8.6620000000000008},"last":1.5549999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2829999999999999,"15min":1.395},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.04,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.514,"15min":1.5920000000000001},"min":{"1min":1.1519999999999999,"5min":1.081,"15min":1.081},"max":{"1min":2.1909999999999998,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":1.5249999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.7490000000000001,"5min":2.0190000000000001,"15min":2.157},"min":{"1min":1.232,"5min":1.113,"15min":1.113},"max":{"1min":2.927,"5min":9.2119999999999997,"15min":9.2119999999999997},"last":1.637},{"interface":"front","average":{"1min":1.8360000000000001,"5min":8.0169999999999995,"15min":5.3040000000000003},"min":{"1min":1.181,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":4.8109999999999999,"5min":310.995,"15min":332.43700000000001},"last":1.4830000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.625,"15min":1.9119999999999999},"min":{"1min":1.2549999999999999,"5min":1.143,"15min":1.143},"max":{"1min":2.5369999999999999,"5min":3.9380000000000002,"15min":8.2669999999999995},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.542,"5min":1.603,"15min":1.587},"min":{"1min":1.224,"5min":1.044,"15min":1.044},"max":{"1min":2.7250000000000001,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.728}]},{"osd":11,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4830000000000001,"15min":1.6160000000000001},"min":{"1min":1.115,"5min":1.018,"15min":1.018},"max":{"1min":2.7189999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.6839999999999999,"15min":1.9970000000000001},"min":{"1min":1.351,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.4289999999999998,"5min":3.8079999999999998,"15min":8.4329999999999998},"last":1.7070000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444138,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":839492,"kb_used_data":92859888,"kb_used_omap":17242,"kb_used_meta":0,"kb_avail":92859888,"statfs":{"total":95948165120,"available":95088525312,"internally_reserved":0,"allocated":95088525312,"data_stored":95088525312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17656765,"internal_metadata":0},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.252,"15min":1.486},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.9750000000000001,"5min":6.4859999999999998,"15min":7.1699999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.153,"15min":1.319},"min":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":8.7669999999999995},"last":1.129}]},{"osd":1,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.0029999999999999,"15min":1.036},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.1619999999999999,"5min":1.532,"15min":1.613},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.01,"5min":0.96799999999999997,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.63600000000000001},"max":{"1min":4.3010000000000002,"5min":4.3010000000000002,"15min":4.3010000000000002},"last":0.83799999999999997}]},{"osd":2,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.294,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.876,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.4890000000000001,"15min":1.5680000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.085,"15min":1.1279999999999999},"min":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.8529999999999998,"5min":4.8529999999999998,"15min":4.8529999999999998},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.1899999999999999,"15min":1.2909999999999999},"min":{"1min":0.90900000000000003,"5min":0.879,"15min":0.879},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":3.3900000000000001},"last":1.155}]},{"osd":6,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.696,"15min":1.702},"min":{"1min":1.006,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":5.2489999999999997,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.835,"5min":1.7869999999999999,"15min":1.8340000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":6.5019999999999998,"5min":8.7279999999999998,"15min":8.7279999999999998},"last":1.391}]},{"osd":7,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":1.038,"5min":0.92900000000000005,"15min":0.86899999999999999},"max":{"1min":2.0379999999999998,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.377,"15min":1.429},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.98899999999999999},"max":{"1min":1.5289999999999999,"5min":1.911,"15min":2.3690000000000002},"last":1.2270000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.248,"15min":1.27},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.486,"15min":1.53},"min":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.054},"max":{"1min":2.1680000000000001,"5min":2.254,"15min":2.254},"last":1.4399999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.8460000000000001,"15min":2.0179999999999998},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.5129999999999999,"5min":5.7599999999999998,"15min":5.7599999999999998},"last":1.8660000000000001},{"interface":"front","average":{"1min":1.7,"5min":1.821,"15min":1.946},"min":{"1min":1.077,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":5.0780000000000003,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":1.6539999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.5760000000000001,"15min":1.6439999999999999},"min":{"1min":1.2869999999999999,"5min":1.23,"15min":1.23},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.577},{"interface":"front","average":{"1min":1.413,"5min":1.52,"15min":1.589},"min":{"1min":1.105,"5min":1.105,"15min":1.052},"max":{"1min":1.7450000000000001,"5min":2.0299999999999998,"15min":2.3719999999999999},"last":1.4259999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":5.016,"5min":5.016,"15min":5.016},"last":1.524},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6779999999999999,"15min":1.7450000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":2.2599999999999998,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.6930000000000001}]}]}]}} 2020-11-20T12:22:36.977 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2020-11-20T12:14:09.307066+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=9, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.977 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2020-11-20T12:14:10.318094+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=10, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.977 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-20T12:14:05.141692+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.978 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2020-11-20T12:14:09.307066+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=9, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.978 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2020-11-20T12:14:10.318094+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=10, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.978 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2020-11-20T12:14:09.307066+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=9, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.979 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2020-11-20T12:14:10.318094+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=10, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.979 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-20T12:14:05.141692+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.979 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-20T12:13:54.281756+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=13, tm_sec=54, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.980 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2020-11-20T12:14:09.307066+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=9, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.980 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-20T12:14:05.141692+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.980 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2020-11-20T12:14:09.307066+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=9, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.981 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2020-11-20T12:14:10.318094+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=10, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.981 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2020-11-20T12:14:09.307066+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=9, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.981 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-20T12:14:05.141692+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.982 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2020-11-20T12:14:10.318094+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=10, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.982 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-20T12:14:05.141692+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=5, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.982 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2020-11-20T12:14:09.307066+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=14, tm_sec=9, tm_wday=4, tm_yday=325, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=20, tm_hour=12, tm_min=22, tm_sec=26, tm_wday=4, tm_yday=325, tm_isdst=0) 2020-11-20T12:22:36.983 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2020-11-20T12:22:56.983 INFO:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:22:57.218 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.215+0000 7fba8e798700 1 Processor -- start 2020-11-20T12:22:57.218 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.215+0000 7fba8e798700 1 -- start start 2020-11-20T12:22:57.219 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.216+0000 7fba8e798700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fba880630b0 0x7fba88063490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.220 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.216+0000 7fba8e798700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba880616b0 0x7fba880bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.220 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.216+0000 7fba8e798700 1 -- --> v1:172.21.15.150:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba88061b80 con 0x7fba880bfc10 2020-11-20T12:22:57.220 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.216+0000 7fba8e798700 1 -- --> v2:172.21.15.150:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880c3ba0 con 0x7fba880616b0 2020-11-20T12:22:57.220 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.216+0000 7fba8e798700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba88062600 con 0x7fba880630b0 2020-11-20T12:22:57.222 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8cf95700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba880616b0 0x7fba880bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.222 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8d796700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fba880630b0 0x7fba88063490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.223 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8cf95700 1 --2- >> v2:172.21.15.150:3300/0 conn(0x7fba880616b0 0x7fba880bf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52130/0 (socket says 172.21.15.160:52130) 2020-11-20T12:22:57.223 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8df97700 1 --1- >> v1:172.21.15.150:6789/0 conn(0x7fba880bfc10 0x7fba880c4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.150:6789/0 says I am v1:172.21.15.160:47836/0 (socket says 172.21.15.160:47836) 2020-11-20T12:22:57.223 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8cf95700 1 -- 172.21.15.160:0/778618455 learned_addr learned my addr 172.21.15.160:0/778618455 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:57.225 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8d796700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7fba880630b0 0x7fba88063490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:38996/0 (socket says 172.21.15.160:38996) 2020-11-20T12:22:57.225 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8d796700 1 -- 172.21.15.160:0/778618455 >> v2:172.21.15.150:3300/0 conn(0x7fba880616b0 msgr2=0x7fba880bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:57.225 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8d796700 1 --2- 172.21.15.160:0/778618455 >> v2:172.21.15.150:3300/0 conn(0x7fba880616b0 0x7fba880bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.217+0000 7fba8d796700 1 -- 172.21.15.160:0/778618455 >> v1:172.21.15.150:6789/0 conn(0x7fba880bfc10 legacy=0x7fba880c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.218+0000 7fba77fff700 1 -- 172.21.15.160:0/778618455 <== mon.1 v1:172.21.15.150:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988586552 0 0) 0x7fba88061b80 con 0x7fba880bfc10 2020-11-20T12:22:57.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.218+0000 7fba8d796700 1 -- 172.21.15.160:0/778618455 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88061e20 con 0x7fba880630b0 2020-11-20T12:22:57.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.218+0000 7fba8cf95700 1 --2- 172.21.15.160:0/778618455 >> v2:172.21.15.150:3300/0 conn(0x7fba880616b0 0x7fba880bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:57.226 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.218+0000 7fba8d796700 1 --2- 172.21.15.160:0/778618455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba88063490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fba880c83b0 tx=0x7fba84006d90).ready entity=mon.2 client_cookie=2a905e742e11587d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:57.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.218+0000 7fba77fff700 1 -- 172.21.15.160:0/778618455 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84006030 con 0x7fba880630b0 2020-11-20T12:22:57.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.218+0000 7fba77fff700 1 -- 172.21.15.160:0/778618455 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84006190 con 0x7fba880630b0 2020-11-20T12:22:57.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.218+0000 7fba77fff700 1 -- 172.21.15.160:0/778618455 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84006510 con 0x7fba880630b0 2020-11-20T12:22:57.227 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 -- 172.21.15.160:0/778618455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 msgr2=0x7fba88063490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 --2- 172.21.15.160:0/778618455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba88063490 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fba880c83b0 tx=0x7fba84006d90).stop 2020-11-20T12:22:57.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 -- 172.21.15.160:0/778618455 shutdown_connections 2020-11-20T12:22:57.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 --2- 172.21.15.160:0/778618455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba88063490 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 --2- 172.21.15.160:0/778618455 >> v2:172.21.15.150:3300/0 conn(0x7fba880616b0 0x7fba880bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.228 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 -- 172.21.15.160:0/778618455 >> 172.21.15.160:0/778618455 conn(0x7fba88060140 msgr2=0x7fba88060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:57.229 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 -- 172.21.15.160:0/778618455 shutdown_connections 2020-11-20T12:22:57.229 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.219+0000 7fba8e798700 1 -- 172.21.15.160:0/778618455 wait complete. 2020-11-20T12:22:57.231 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.220+0000 7fba8e798700 1 Processor -- start 2020-11-20T12:22:57.231 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.221+0000 7fba8e798700 1 -- start start 2020-11-20T12:22:57.232 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.221+0000 7fba8e798700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba880616b0 0x7fba881600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.232 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.221+0000 7fba8e798700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba880c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.232 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.221+0000 7fba8e798700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba880bfc10 0x7fba88150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.232 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.221+0000 7fba8e798700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba881605b0 con 0x7fba880bfc10 2020-11-20T12:22:57.232 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.221+0000 7fba8e798700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8814db30 con 0x7fba880616b0 2020-11-20T12:22:57.233 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.221+0000 7fba8e798700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba881607d0 con 0x7fba880630b0 2020-11-20T12:22:57.233 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8d796700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba880616b0 0x7fba881600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.233 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8cf95700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba880c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.233 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8d796700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba880616b0 0x7fba881600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52134/0 (socket says 172.21.15.160:52134) 2020-11-20T12:22:57.233 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8d796700 1 -- 172.21.15.160:0/1673420993 learned_addr learned my addr 172.21.15.160:0/1673420993 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:57.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8df97700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba880bfc10 0x7fba88150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8cf95700 1 -- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba880616b0 msgr2=0x7fba881600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8cf95700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba880616b0 0x7fba881600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.234 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8cf95700 1 -- 172.21.15.160:0/1673420993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba880bfc10 msgr2=0x7fba88150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8cf95700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba880bfc10 0x7fba88150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8cf95700 1 -- 172.21.15.160:0/1673420993 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88160a70 con 0x7fba880630b0 2020-11-20T12:22:57.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.222+0000 7fba8d796700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba880616b0 0x7fba881600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:57.235 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.223+0000 7fba8cf95700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba880c4340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fba7800ecf0 tx=0x7fba78006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:57.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.223+0000 7fba757fa700 1 -- 172.21.15.160:0/1673420993 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800ca40 con 0x7fba880630b0 2020-11-20T12:22:57.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.223+0000 7fba757fa700 1 -- 172.21.15.160:0/1673420993 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7800cba0 con 0x7fba880630b0 2020-11-20T12:22:57.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.223+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba88160d10 con 0x7fba880630b0 2020-11-20T12:22:57.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.223+0000 7fba757fa700 1 -- 172.21.15.160:0/1673420993 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780123f0 con 0x7fba880630b0 2020-11-20T12:22:57.236 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.223+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba88155530 con 0x7fba880630b0 2020-11-20T12:22:57.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.224+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba88044f60 con 0x7fba880630b0 2020-11-20T12:22:57.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.225+0000 7fba757fa700 1 -- 172.21.15.160:0/1673420993 <== mon.2 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fba78022070 con 0x7fba880630b0 2020-11-20T12:22:57.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.226+0000 7fba757fa700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fba60080630 0x7fba60082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.237 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.226+0000 7fba757fa700 1 -- 172.21.15.160:0/1673420993 <== mon.2 v2:172.21.15.160:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7fba780a2e70 con 0x7fba880630b0 2020-11-20T12:22:57.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.226+0000 7fba8d796700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fba60080630 0x7fba60082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.227+0000 7fba8d796700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fba60080630 0x7fba60082af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fba840093c0 tx=0x7fba84015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:57.238 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.230+0000 7fba757fa700 1 -- 172.21.15.160:0/1673420993 <== mon.2 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fba78077960 con 0x7fba880630b0 2020-11-20T12:22:57.416 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.411+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 --> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba8805c430 con 0x7fba60080630 2020-11-20T12:22:57.420 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.418+0000 7fba757fa700 1 -- 172.21.15.160:0/1673420993 <== mgr.4108 v2:172.21.15.150:6800/21431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+148980 (secure 0 0 0) 0x7fba8805c430 con 0x7fba60080630 2020-11-20T12:22:57.423 INFO:teuthology.orchestra.run.smithi160.stdout: 2020-11-20T12:22:57.424 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.420+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fba60080630 msgr2=0x7fba60082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.424 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.420+0000 7fba8e798700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fba60080630 0x7fba60082af0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fba840093c0 tx=0x7fba84015000).stop 2020-11-20T12:22:57.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.420+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 msgr2=0x7fba880c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.420+0000 7fba8e798700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba880c4340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fba7800ecf0 tx=0x7fba78006eb0).stop 2020-11-20T12:22:57.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 shutdown_connections 2020-11-20T12:22:57.425 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7fba60080630 0x7fba60082af0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba880bfc10 0x7fba88150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba880616b0 0x7fba881600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 --2- 172.21.15.160:0/1673420993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba880630b0 0x7fba880c4340 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.426 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 >> 172.21.15.160:0/1673420993 conn(0x7fba88060140 msgr2=0x7fba880c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:57.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 shutdown_connections 2020-11-20T12:22:57.427 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.421+0000 7fba8e798700 1 -- 172.21.15.160:0/1673420993 wait complete. 2020-11-20T12:22:57.427 INFO:teuthology.orchestra.run.smithi160.stderr:dumped all 2020-11-20T12:22:57.444 INFO:teuthology.orchestra.run.smithi160.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2020-11-20T12:22:56.204351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":217795658,"num_objects":77,"num_object_clones":0,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":1318,"num_read_kb":4884,"num_write":116319,"num_write_kb":1168332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":68488,"num_omap_keys":95,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86723,"ondisk_log_size":86723,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":12,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1124392560,"kb_used":10073324,"kb_used_data":1114319236,"kb_used_omap":188623,"kb_used_meta":0,"kb_avail":1114319236,"statfs":{"total":1151377981440,"available":1141062897664,"internally_reserved":0,"allocated":1141062897664,"data_stored":1141062897664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":193150254,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002642"},"pg_stats":[{"pgid":"4.2","version":"26'12175","reported_seq":"12187","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:31.701656+0000","last_change":"2020-11-20T12:22:31.701702+0000","last_active":"2020-11-20T12:22:31.701656+0000","last_peered":"2020-11-20T12:22:31.701656+0000","last_clean":"2020-11-20T12:22:31.701656+0000","last_became_active":"2020-11-20T12:14:10.894103+0000","last_became_peered":"2020-11-20T12:14:10.894103+0000","last_unstale":"2020-11-20T12:22:31.701656+0000","last_undegraded":"2020-11-20T12:22:31.701656+0000","last_fullsized":"2020-11-20T12:22:31.701656+0000","mapping_epoch":24,"log_start":"26'2100","ondisk_log_start":"26'2100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12175","last_scrub_stamp":"2020-11-20T12:22:31.701652+0000","last_deep_scrub":"26'12175","last_deep_scrub_stamp":"2020-11-20T12:22:31.701652+0000","last_clean_scrub_stamp":"2020-11-20T12:22:31.701652+0000","log_size":10075,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13374,"num_write_kb":78386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:33.220425+0000","last_change":"2020-11-20T12:22:33.220487+0000","last_active":"2020-11-20T12:22:33.220425+0000","last_peered":"2020-11-20T12:22:33.220425+0000","last_clean":"2020-11-20T12:22:33.220425+0000","last_became_active":"2020-11-20T12:14:06.159519+0000","last_became_peered":"2020-11-20T12:14:06.159519+0000","last_unstale":"2020-11-20T12:22:33.220425+0000","last_undegraded":"2020-11-20T12:22:33.220425+0000","last_fullsized":"2020-11-20T12:22:33.220425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:33.220419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:33.220419+0000","last_clean_scrub_stamp":"2020-11-20T12:22:33.220419+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"26'972","reported_seq":"985","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:38.409514+0000","last_change":"2020-11-20T12:22:38.409576+0000","last_active":"2020-11-20T12:22:38.409514+0000","last_peered":"2020-11-20T12:22:38.409514+0000","last_clean":"2020-11-20T12:22:38.409514+0000","last_became_active":"2020-11-20T12:14:10.335057+0000","last_became_peered":"2020-11-20T12:14:10.335057+0000","last_unstale":"2020-11-20T12:22:38.409514+0000","last_undegraded":"2020-11-20T12:22:38.409514+0000","last_fullsized":"2020-11-20T12:22:38.409514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'972","last_scrub_stamp":"2020-11-20T12:22:38.409506+0000","last_deep_scrub":"26'972","last_deep_scrub_stamp":"2020-11-20T12:22:38.409506+0000","last_clean_scrub_stamp":"2020-11-20T12:22:38.409506+0000","log_size":972,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41943200,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":1222,"num_write_kb":97964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'12274","reported_seq":"12286","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:38.250007+0000","last_change":"2020-11-20T12:22:38.250069+0000","last_active":"2020-11-20T12:22:38.250007+0000","last_peered":"2020-11-20T12:22:38.250007+0000","last_clean":"2020-11-20T12:22:38.250007+0000","last_became_active":"2020-11-20T12:14:10.895690+0000","last_became_peered":"2020-11-20T12:14:10.895690+0000","last_unstale":"2020-11-20T12:22:38.250007+0000","last_undegraded":"2020-11-20T12:22:38.250007+0000","last_fullsized":"2020-11-20T12:22:38.250007+0000","mapping_epoch":24,"log_start":"26'2200","ondisk_log_start":"26'2200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12274","last_scrub_stamp":"2020-11-20T12:22:38.250001+0000","last_deep_scrub":"26'12274","last_deep_scrub_stamp":"2020-11-20T12:22:38.250001+0000","last_clean_scrub_stamp":"2020-11-20T12:22:38.250001+0000","log_size":10074,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13504,"num_write_kb":81662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:35.345980+0000","last_change":"2020-11-20T12:22:35.346039+0000","last_active":"2020-11-20T12:22:35.345980+0000","last_peered":"2020-11-20T12:22:35.345980+0000","last_clean":"2020-11-20T12:22:35.345980+0000","last_became_active":"2020-11-20T12:14:07.008291+0000","last_became_peered":"2020-11-20T12:14:07.008291+0000","last_unstale":"2020-11-20T12:22:35.345980+0000","last_undegraded":"2020-11-20T12:22:35.345980+0000","last_fullsized":"2020-11-20T12:22:35.345980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:35.345975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:35.345975+0000","last_clean_scrub_stamp":"2020-11-20T12:22:35.345975+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"26'622","reported_seq":"635","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:42.267500+0000","last_change":"2020-11-20T12:22:42.267550+0000","last_active":"2020-11-20T12:22:42.267500+0000","last_peered":"2020-11-20T12:22:42.267500+0000","last_clean":"2020-11-20T12:22:42.267500+0000","last_became_active":"2020-11-20T12:14:10.534094+0000","last_became_peered":"2020-11-20T12:14:10.534094+0000","last_unstale":"2020-11-20T12:22:42.267500+0000","last_undegraded":"2020-11-20T12:22:42.267500+0000","last_fullsized":"2020-11-20T12:22:42.267500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'622","last_scrub_stamp":"2020-11-20T12:22:42.267494+0000","last_deep_scrub":"26'622","last_deep_scrub_stamp":"2020-11-20T12:22:42.267494+0000","last_clean_scrub_stamp":"2020-11-20T12:22:42.267494+0000","log_size":622,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":29360162,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":69,"num_read_kb":0,"num_write":932,"num_write_kb":65028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5052,"num_omap_keys":11,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.7","version":"26'12061","reported_seq":"12073","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:43.246669+0000","last_change":"2020-11-20T12:22:43.246737+0000","last_active":"2020-11-20T12:22:43.246669+0000","last_peered":"2020-11-20T12:22:43.246669+0000","last_clean":"2020-11-20T12:22:43.246669+0000","last_became_active":"2020-11-20T12:14:10.898829+0000","last_became_peered":"2020-11-20T12:14:10.898829+0000","last_unstale":"2020-11-20T12:22:43.246669+0000","last_undegraded":"2020-11-20T12:22:43.246669+0000","last_fullsized":"2020-11-20T12:22:43.246669+0000","mapping_epoch":24,"log_start":"26'2000","ondisk_log_start":"26'2000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12061","last_scrub_stamp":"2020-11-20T12:22:43.246662+0000","last_deep_scrub":"26'12061","last_deep_scrub_stamp":"2020-11-20T12:22:43.246662+0000","last_clean_scrub_stamp":"2020-11-20T12:22:43.246662+0000","log_size":10061,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13210,"num_write_kb":79226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:33.117012+0000","last_change":"2020-11-20T12:22:33.117079+0000","last_active":"2020-11-20T12:22:33.117012+0000","last_peered":"2020-11-20T12:22:33.117012+0000","last_clean":"2020-11-20T12:22:33.117012+0000","last_became_active":"2020-11-20T12:14:07.008127+0000","last_became_peered":"2020-11-20T12:14:07.008127+0000","last_unstale":"2020-11-20T12:22:33.117012+0000","last_undegraded":"2020-11-20T12:22:33.117012+0000","last_fullsized":"2020-11-20T12:22:33.117012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:33.117008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:33.117008+0000","last_clean_scrub_stamp":"2020-11-20T12:22:33.117008+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,10],"acting":[7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"26'670","reported_seq":"683","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:33.496216+0000","last_change":"2020-11-20T12:22:33.496260+0000","last_active":"2020-11-20T12:22:33.496216+0000","last_peered":"2020-11-20T12:22:33.496216+0000","last_clean":"2020-11-20T12:22:33.496216+0000","last_became_active":"2020-11-20T12:14:10.340407+0000","last_became_peered":"2020-11-20T12:14:10.340407+0000","last_unstale":"2020-11-20T12:22:33.496216+0000","last_undegraded":"2020-11-20T12:22:33.496216+0000","last_fullsized":"2020-11-20T12:22:33.496216+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'670","last_scrub_stamp":"2020-11-20T12:22:33.496212+0000","last_deep_scrub":"26'670","last_deep_scrub_stamp":"2020-11-20T12:22:33.496212+0000","last_clean_scrub_stamp":"2020-11-20T12:22:33.496212+0000","log_size":670,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25165824,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":68,"num_read_kb":0,"num_write":944,"num_write_kb":72883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":51037,"num_omap_keys":81,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"26'12189","reported_seq":"12201","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:43.400962+0000","last_change":"2020-11-20T12:22:43.401023+0000","last_active":"2020-11-20T12:22:43.400962+0000","last_peered":"2020-11-20T12:22:43.400962+0000","last_clean":"2020-11-20T12:22:43.400962+0000","last_became_active":"2020-11-20T12:14:10.894032+0000","last_became_peered":"2020-11-20T12:14:10.894032+0000","last_unstale":"2020-11-20T12:22:43.400962+0000","last_undegraded":"2020-11-20T12:22:43.400962+0000","last_fullsized":"2020-11-20T12:22:43.400962+0000","mapping_epoch":24,"log_start":"26'2100","ondisk_log_start":"26'2100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12189","last_scrub_stamp":"2020-11-20T12:22:43.400956+0000","last_deep_scrub":"26'12189","last_deep_scrub_stamp":"2020-11-20T12:22:43.400956+0000","last_clean_scrub_stamp":"2020-11-20T12:22:43.400956+0000","log_size":10089,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13414,"num_write_kb":79172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:39.142107+0000","last_change":"2020-11-20T12:22:39.142172+0000","last_active":"2020-11-20T12:22:39.142107+0000","last_peered":"2020-11-20T12:22:39.142107+0000","last_clean":"2020-11-20T12:22:39.142107+0000","last_became_active":"2020-11-20T12:14:06.158623+0000","last_became_peered":"2020-11-20T12:14:06.158623+0000","last_unstale":"2020-11-20T12:22:39.142107+0000","last_undegraded":"2020-11-20T12:22:39.142107+0000","last_fullsized":"2020-11-20T12:22:39.142107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:39.142103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:39.142103+0000","last_clean_scrub_stamp":"2020-11-20T12:22:39.142103+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"1.0","version":"26'6","reported_seq":"25","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:36.546441+0000","last_change":"2020-11-20T12:22:36.546501+0000","last_active":"2020-11-20T12:22:36.546441+0000","last_peered":"2020-11-20T12:22:36.546441+0000","last_clean":"2020-11-20T12:22:36.546441+0000","last_became_active":"2020-11-20T12:13:58.997799+0000","last_became_peered":"2020-11-20T12:13:58.997799+0000","last_unstale":"2020-11-20T12:22:36.546441+0000","last_undegraded":"2020-11-20T12:22:36.546441+0000","last_fullsized":"2020-11-20T12:22:36.546441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'6","last_scrub_stamp":"2020-11-20T12:22:36.546434+0000","last_deep_scrub":"26'6","last_deep_scrub_stamp":"2020-11-20T12:22:36.546434+0000","last_clean_scrub_stamp":"2020-11-20T12:22:36.546434+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12399,"num_omap_keys":3,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"26'712","reported_seq":"725","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:38.425596+0000","last_change":"2020-11-20T12:22:38.425671+0000","last_active":"2020-11-20T12:22:38.425596+0000","last_peered":"2020-11-20T12:22:38.425596+0000","last_clean":"2020-11-20T12:22:38.425596+0000","last_became_active":"2020-11-20T12:14:10.537671+0000","last_became_peered":"2020-11-20T12:14:10.537671+0000","last_unstale":"2020-11-20T12:22:38.425596+0000","last_undegraded":"2020-11-20T12:22:38.425596+0000","last_fullsized":"2020-11-20T12:22:38.425596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'712","last_scrub_stamp":"2020-11-20T12:22:38.425586+0000","last_deep_scrub":"26'712","last_deep_scrub_stamp":"2020-11-20T12:22:38.425586+0000","last_clean_scrub_stamp":"2020-11-20T12:22:38.425586+0000","log_size":712,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37156902,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":74,"num_read_kb":0,"num_write":1013,"num_write_kb":80798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.6","version":"26'11965","reported_seq":"11977","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:32.733313+0000","last_change":"2020-11-20T12:22:32.733375+0000","last_active":"2020-11-20T12:22:32.733313+0000","last_peered":"2020-11-20T12:22:32.733313+0000","last_clean":"2020-11-20T12:22:32.733313+0000","last_became_active":"2020-11-20T12:14:10.894932+0000","last_became_peered":"2020-11-20T12:14:10.894932+0000","last_unstale":"2020-11-20T12:22:32.733313+0000","last_undegraded":"2020-11-20T12:22:32.733313+0000","last_fullsized":"2020-11-20T12:22:32.733313+0000","mapping_epoch":24,"log_start":"26'1900","ondisk_log_start":"26'1900","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'11965","last_scrub_stamp":"2020-11-20T12:22:32.733309+0000","last_deep_scrub":"26'11965","last_deep_scrub_stamp":"2020-11-20T12:22:32.733309+0000","last_clean_scrub_stamp":"2020-11-20T12:22:32.733309+0000","log_size":10065,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13123,"num_write_kb":78974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10],"acting":[9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:37.567333+0000","last_change":"2020-11-20T12:22:37.567398+0000","last_active":"2020-11-20T12:22:37.567333+0000","last_peered":"2020-11-20T12:22:37.567333+0000","last_clean":"2020-11-20T12:22:37.567333+0000","last_became_active":"2020-11-20T12:14:06.162506+0000","last_became_peered":"2020-11-20T12:14:06.162506+0000","last_unstale":"2020-11-20T12:22:37.567333+0000","last_undegraded":"2020-11-20T12:22:37.567333+0000","last_fullsized":"2020-11-20T12:22:37.567333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:37.567329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:37.567329+0000","last_clean_scrub_stamp":"2020-11-20T12:22:37.567329+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"26'1280","reported_seq":"2059","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:33.363550+0000","last_change":"2020-11-20T12:22:33.363602+0000","last_active":"2020-11-20T12:22:33.363550+0000","last_peered":"2020-11-20T12:22:33.363550+0000","last_clean":"2020-11-20T12:22:33.363550+0000","last_became_active":"2020-11-20T12:14:10.336077+0000","last_became_peered":"2020-11-20T12:14:10.336077+0000","last_unstale":"2020-11-20T12:22:33.363550+0000","last_undegraded":"2020-11-20T12:22:33.363550+0000","last_fullsized":"2020-11-20T12:22:33.363550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1280","last_scrub_stamp":"2020-11-20T12:22:33.363543+0000","last_deep_scrub":"26'1280","last_deep_scrub_stamp":"2020-11-20T12:22:33.363543+0000","last_clean_scrub_stamp":"2020-11-20T12:22:33.363543+0000","log_size":1280,"ondisk_log_size":1280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":833,"num_read_kb":4591,"num_write":1588,"num_write_kb":41099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"26'12431","reported_seq":"12443","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:28.400779+0000","last_change":"2020-11-20T12:22:28.400829+0000","last_active":"2020-11-20T12:22:28.400779+0000","last_peered":"2020-11-20T12:22:28.400779+0000","last_clean":"2020-11-20T12:22:28.400779+0000","last_became_active":"2020-11-20T12:14:10.896333+0000","last_became_peered":"2020-11-20T12:14:10.896333+0000","last_unstale":"2020-11-20T12:22:28.400779+0000","last_undegraded":"2020-11-20T12:22:28.400779+0000","last_fullsized":"2020-11-20T12:22:28.400779+0000","mapping_epoch":24,"log_start":"26'2400","ondisk_log_start":"26'2400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12431","last_scrub_stamp":"2020-11-20T12:22:28.400775+0000","last_deep_scrub":"26'12431","last_deep_scrub_stamp":"2020-11-20T12:22:28.400775+0000","last_clean_scrub_stamp":"2020-11-20T12:22:28.400775+0000","log_size":10031,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13626,"num_write_kb":83115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:32.371709+0000","last_change":"2020-11-20T12:22:32.371782+0000","last_active":"2020-11-20T12:22:32.371709+0000","last_peered":"2020-11-20T12:22:32.371709+0000","last_clean":"2020-11-20T12:22:32.371709+0000","last_became_active":"2020-11-20T12:14:06.162783+0000","last_became_peered":"2020-11-20T12:14:06.162783+0000","last_unstale":"2020-11-20T12:22:32.371709+0000","last_undegraded":"2020-11-20T12:22:32.371709+0000","last_fullsized":"2020-11-20T12:22:32.371709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:32.371702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:32.371702+0000","last_clean_scrub_stamp":"2020-11-20T12:22:32.371702+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"26'761","reported_seq":"774","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:39.341280+0000","last_change":"2020-11-20T12:22:39.341338+0000","last_active":"2020-11-20T12:22:39.341280+0000","last_peered":"2020-11-20T12:22:39.341280+0000","last_clean":"2020-11-20T12:22:39.341280+0000","last_became_active":"2020-11-20T12:14:10.339332+0000","last_became_peered":"2020-11-20T12:14:10.339332+0000","last_unstale":"2020-11-20T12:22:39.341280+0000","last_undegraded":"2020-11-20T12:22:39.341280+0000","last_fullsized":"2020-11-20T12:22:39.341280+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'761","last_scrub_stamp":"2020-11-20T12:22:39.341273+0000","last_deep_scrub":"26'761","last_deep_scrub_stamp":"2020-11-20T12:22:39.341273+0000","last_clean_scrub_stamp":"2020-11-20T12:22:39.341273+0000","log_size":761,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16777859,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":85,"num_read_kb":0,"num_write":1106,"num_write_kb":48894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.0","version":"26'12533","reported_seq":"12545","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:43.259522+0000","last_change":"2020-11-20T12:22:43.259587+0000","last_active":"2020-11-20T12:22:43.259522+0000","last_peered":"2020-11-20T12:22:43.259522+0000","last_clean":"2020-11-20T12:22:43.259522+0000","last_became_active":"2020-11-20T12:14:10.891647+0000","last_became_peered":"2020-11-20T12:14:10.891647+0000","last_unstale":"2020-11-20T12:22:43.259522+0000","last_undegraded":"2020-11-20T12:22:43.259522+0000","last_fullsized":"2020-11-20T12:22:43.259522+0000","mapping_epoch":24,"log_start":"26'2500","ondisk_log_start":"26'2500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12533","last_scrub_stamp":"2020-11-20T12:22:43.259516+0000","last_deep_scrub":"26'12533","last_deep_scrub_stamp":"2020-11-20T12:22:43.259516+0000","last_clean_scrub_stamp":"2020-11-20T12:22:43.259516+0000","log_size":10033,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13769,"num_write_kb":84684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'550","reported_seq":"590","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:40.347944+0000","last_change":"2020-11-20T12:22:40.348002+0000","last_active":"2020-11-20T12:22:40.347944+0000","last_peered":"2020-11-20T12:22:40.347944+0000","last_clean":"2020-11-20T12:22:40.347944+0000","last_became_active":"2020-11-20T12:14:10.339274+0000","last_became_peered":"2020-11-20T12:14:10.339274+0000","last_unstale":"2020-11-20T12:22:40.347944+0000","last_undegraded":"2020-11-20T12:22:40.347944+0000","last_fullsized":"2020-11-20T12:22:40.347944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'550","last_scrub_stamp":"2020-11-20T12:22:40.347938+0000","last_deep_scrub":"26'550","last_deep_scrub_stamp":"2020-11-20T12:22:40.347938+0000","last_clean_scrub_stamp":"2020-11-20T12:22:40.347938+0000","log_size":550,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8671455,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":84,"num_read_kb":293,"num_write":839,"num_write_kb":32657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:37.281038+0000","last_change":"2020-11-20T12:22:37.281103+0000","last_active":"2020-11-20T12:22:37.281038+0000","last_peered":"2020-11-20T12:22:37.281038+0000","last_clean":"2020-11-20T12:22:37.281038+0000","last_became_active":"2020-11-20T12:14:06.894112+0000","last_became_peered":"2020-11-20T12:14:06.894112+0000","last_unstale":"2020-11-20T12:22:37.281038+0000","last_undegraded":"2020-11-20T12:22:37.281038+0000","last_fullsized":"2020-11-20T12:22:37.281038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:37.281032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:37.281032+0000","last_clean_scrub_stamp":"2020-11-20T12:22:37.281032+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"26'12311","reported_seq":"12323","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:34.861982+0000","last_change":"2020-11-20T12:22:34.862078+0000","last_active":"2020-11-20T12:22:34.861982+0000","last_peered":"2020-11-20T12:22:34.861982+0000","last_clean":"2020-11-20T12:22:34.861982+0000","last_became_active":"2020-11-20T12:14:11.293129+0000","last_became_peered":"2020-11-20T12:14:11.293129+0000","last_unstale":"2020-11-20T12:22:34.861982+0000","last_undegraded":"2020-11-20T12:22:34.861982+0000","last_fullsized":"2020-11-20T12:22:34.861982+0000","mapping_epoch":24,"log_start":"26'2300","ondisk_log_start":"26'2300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'12311","last_scrub_stamp":"2020-11-20T12:22:34.861978+0000","last_deep_scrub":"26'12311","last_deep_scrub_stamp":"2020-11-20T12:22:34.861978+0000","last_clean_scrub_stamp":"2020-11-20T12:22:34.861978+0000","log_size":10011,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13536,"num_write_kb":82637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"16","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:41.555949+0000","last_change":"2020-11-20T12:22:41.556017+0000","last_active":"2020-11-20T12:22:41.555949+0000","last_peered":"2020-11-20T12:22:41.555949+0000","last_clean":"2020-11-20T12:22:41.555949+0000","last_became_active":"2020-11-20T12:14:06.894407+0000","last_became_peered":"2020-11-20T12:14:06.894407+0000","last_unstale":"2020-11-20T12:22:41.555949+0000","last_undegraded":"2020-11-20T12:22:41.555949+0000","last_fullsized":"2020-11-20T12:22:41.555949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:22:41.555943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:22:41.555943+0000","last_clean_scrub_stamp":"2020-11-20T12:22:41.555943+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.6","version":"26'711","reported_seq":"724","reported_epoch":"26","state":"active+clean","last_fresh":"2020-11-20T12:22:35.417825+0000","last_change":"2020-11-20T12:22:35.417872+0000","last_active":"2020-11-20T12:22:35.417825+0000","last_peered":"2020-11-20T12:22:35.417825+0000","last_clean":"2020-11-20T12:22:35.417825+0000","last_became_active":"2020-11-20T12:14:10.532589+0000","last_became_peered":"2020-11-20T12:14:10.532589+0000","last_unstale":"2020-11-20T12:22:35.417825+0000","last_undegraded":"2020-11-20T12:22:35.417825+0000","last_fullsized":"2020-11-20T12:22:35.417825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'711","last_scrub_stamp":"2020-11-20T12:22:35.417820+0000","last_deep_scrub":"26'711","last_deep_scrub_stamp":"2020-11-20T12:22:35.417820+0000","last_clean_scrub_stamp":"2020-11-20T12:22:35.417820+0000","log_size":711,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":50,"num_read_kb":0,"num_write":1116,"num_write_kb":81138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":107556,"num_write_kb":647856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80439,"ondisk_log_size":80439,"up":16,"acting":16,"num_store_stats":0},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":217795658,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1318,"num_read_kb":4884,"num_write":8760,"num_write_kb":520461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56089,"num_omap_keys":92,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6278,"ondisk_log_size":6278,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12399,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":2,"acting":2,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444142,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":846232,"kb_used_data":92853148,"kb_used_omap":16065,"kb_used_meta":0,"kb_avail":92853148,"statfs":{"total":95948165120,"available":95081623552,"internally_reserved":0,"allocated":95081623552,"data_stored":95081623552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":16451577,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.244,"15min":1.5680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.8859999999999999,"5min":4.7069999999999999,"15min":4.7460000000000004},"last":1.375},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.4159999999999999,"15min":1.673},"min":{"1min":0.876,"5min":0.85999999999999999,"15min":0.82899999999999996},"max":{"1min":1.7929999999999999,"5min":4.7569999999999997,"15min":4.8070000000000004},"last":2.024}]},{"osd":1,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.083,"15min":1.1919999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.383,"5min":1.611,"15min":1.8560000000000001},"last":1.623},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.1739999999999999,"15min":1.244},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3600000000000001,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.6970000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.94999999999999996,"15min":0.97299999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.468,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.96099999999999997,"15min":0.96299999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.3620000000000001,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.069}]},{"osd":3,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.0629999999999999,"15min":1.2789999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":2.8740000000000001,"5min":3.1589999999999998,"15min":3.194},"last":2.2999999999999998},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.512,"15min":1.6970000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.996,"5min":3.5099999999999998,"15min":6.4779999999999998},"last":1.9450000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.2210000000000001,"15min":1.262},"min":{"1min":0.747,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.619,"5min":2.7530000000000001,"15min":2.7530000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0640000000000001,"15min":1.097},"min":{"1min":0.76200000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.341,"5min":1.853,"15min":1.853},"last":1.5840000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.3620000000000001,"15min":1.345},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.8069999999999999,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":1.488},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.409,"15min":1.385},"min":{"1min":1.0009999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.7889999999999999,"5min":2.6720000000000002,"15min":2.6720000000000002},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.4810000000000001,"15min":1.6399999999999999},"min":{"1min":0.85999999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1869999999999998,"5min":10.239000000000001,"15min":10.239000000000001},"last":1.8129999999999999},{"interface":"front","average":{"1min":1.641,"5min":1.804,"15min":1.921},"min":{"1min":1.3169999999999999,"5min":1.2649999999999999,"15min":1.2509999999999999},"max":{"1min":2.073,"5min":10.191000000000001,"15min":10.191000000000001},"last":2.0499999999999998}]},{"osd":7,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.5900000000000001,"15min":1.635},"min":{"1min":1.097,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.0169999999999999,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.5609999999999999,"5min":1.589,"15min":1.6439999999999999},"min":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"max":{"1min":1.929,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.8480000000000001}]},{"osd":8,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.282,"15min":1.3180000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.653,"15min":1.7290000000000001},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.1789999999999998,"5min":2.3410000000000002,"15min":2.3410000000000002},"last":1.7430000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.677,"15min":1.706},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":2.1579999999999999,"5min":2.8839999999999999,"15min":2.8839999999999999},"last":1.875},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.4179999999999999,"15min":1.4810000000000001},"min":{"1min":1.0389999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.0579999999999998,"5min":2.532,"15min":2.532},"last":1.456}]}]},{"osd":10,"up_from":17,"seq":73014444141,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":869568,"kb_used_data":92829812,"kb_used_omap":21615,"kb_used_meta":0,"kb_avail":92829812,"statfs":{"total":95948165120,"available":95057727488,"internally_reserved":0,"allocated":95057727488,"data_stored":95057727488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22134678,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.599,"15min":1.8240000000000001},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.69499999999999995},"max":{"1min":3.419,"5min":32.482999999999997,"15min":39.473999999999997},"last":1.052},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.48,"15min":2.3559999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":4.6379999999999999,"5min":32.982999999999997,"15min":239.38800000000001},"last":0.84399999999999997}]},{"osd":1,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.93000000000000005,"15min":1.0289999999999999},"min":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4630000000000001,"5min":6.4720000000000004,"15min":39.573},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.88700000000000001},"min":{"1min":0.629,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.1579999999999999,"5min":1.407,"15min":2.0870000000000002},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.0600000000000001,"15min":1.083},"min":{"1min":0.68700000000000006,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.367,"15min":1.468},"min":{"1min":0.93999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0419999999999998,"5min":6.7140000000000004,"15min":38.835000000000001},"last":1.28}]},{"osd":3,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3959999999999999,"15min":1.667},"min":{"1min":0.749,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":4.125,"5min":4.5640000000000001,"15min":7.9409999999999998},"last":1.554},{"interface":"front","average":{"1min":1.399,"5min":1.47,"15min":1.752},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.80800000000000005},"max":{"1min":2.738,"5min":4.4829999999999997,"15min":8.6170000000000009},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.339,"15min":1.444},"min":{"1min":0.81000000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.2109999999999999,"5min":6.9589999999999996,"15min":38.975000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.214,"15min":1.2470000000000001},"min":{"1min":0.92300000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":1.6499999999999999,"5min":2.2389999999999999,"15min":3.7450000000000001},"last":1.0940000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5129999999999999,"15min":1.899},"min":{"1min":1.0840000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.153,"5min":7.2629999999999999,"15min":39.110999999999997},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3540000000000001,"15min":1.4450000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.7649999999999999,"5min":2.0169999999999999,"15min":3.3410000000000002},"last":1.2390000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.946,"15min":2.694},"min":{"1min":1.2090000000000001,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":2.8660000000000001,"5min":33.418999999999997,"15min":200.03700000000001},"last":1.8009999999999999},{"interface":"front","average":{"1min":1.619,"5min":2.1070000000000002,"15min":2.3220000000000001},"min":{"1min":1.2450000000000001,"5min":1.204,"15min":1.204},"max":{"1min":2.278,"5min":32.927,"15min":39.350999999999999},"last":2.2149999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.526,"15min":1.7829999999999999},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":2.0099999999999998,"5min":3.6360000000000001,"15min":8.1379999999999999},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.462,"15min":1.7},"min":{"1min":0.95899999999999996,"5min":0.876,"15min":0.77700000000000002},"max":{"1min":2.6160000000000001,"5min":3.3100000000000001,"15min":8.7789999999999999},"last":1.522}]},{"osd":9,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.782,"5min":2.2120000000000002,"15min":2.46},"min":{"1min":1.4379999999999999,"5min":1.268,"15min":1.268},"max":{"1min":3.1070000000000002,"5min":29.462,"15min":29.462},"last":2.427},{"interface":"front","average":{"1min":1.702,"5min":2.2799999999999998,"15min":2.5270000000000001},"min":{"1min":1.268,"5min":1.268,"15min":1.268},"max":{"1min":2.4710000000000001,"5min":29.373999999999999,"15min":39.234000000000002},"last":2.0150000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:17 2020","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.5660000000000001,"15min":1.8640000000000001},"min":{"1min":1.2609999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.1269999999999998,"5min":2.2429999999999999,"15min":7.7889999999999997},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.681,"5min":1.6519999999999999,"15min":1.8979999999999999},"min":{"1min":1.224,"5min":1.091,"15min":1.091},"max":{"1min":2.984,"5min":3.4420000000000002,"15min":8.9450000000000003},"last":1.661}]}]},{"osd":9,"up_from":17,"seq":73014444141,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":838152,"kb_used_data":92861228,"kb_used_omap":16880,"kb_used_meta":0,"kb_avail":92861228,"statfs":{"total":95948165120,"available":95089897472,"internally_reserved":0,"allocated":95089897472,"data_stored":95089897472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17285663,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":3.4889999999999999,"15min":3.375},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":5.9969999999999999,"5min":13.090999999999999,"15min":18.306000000000001},"last":2.6960000000000002},{"interface":"front","average":{"1min":3.3279999999999998,"5min":24.893000000000001,"15min":10.641999999999999},"min":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":24.001000000000001,"5min":935.75699999999995,"15min":935.75699999999995},"last":3.0750000000000002}]},{"osd":1,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.077,"5min":12.826000000000001,"15min":6.0579999999999998},"min":{"1min":0.90800000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":23.058,"5min":535.80399999999997,"15min":535.80399999999997},"last":2.7759999999999998},{"interface":"front","average":{"1min":1.6639999999999999,"5min":1.907,"15min":2.4300000000000002},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":3.4609999999999999,"5min":6.7619999999999996,"15min":18.015999999999998},"last":3.9329999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.3319999999999999,"5min":13.041,"15min":6.601},"min":{"1min":0.88800000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":23.382000000000001,"5min":535.95100000000002,"15min":535.95100000000002},"last":4.3250000000000002},{"interface":"front","average":{"1min":1.8280000000000001,"5min":2.1469999999999998,"15min":2.5779999999999998},"min":{"1min":0.79000000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.7709999999999999,"5min":6.6600000000000001,"15min":13.66},"last":2.8809999999999998}]},{"osd":3,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.419,"5min":3.7469999999999999,"15min":3.8900000000000001},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":4.8609999999999998,"5min":13.281000000000001,"15min":14.066000000000001},"last":4.4480000000000004},{"interface":"front","average":{"1min":2.6469999999999998,"5min":3.8929999999999998,"15min":4.3680000000000003},"min":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":7.0049999999999999,"5min":12.503,"15min":18.175999999999998},"last":5.2300000000000004}]},{"osd":4,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.581,"5min":13.481999999999999,"15min":7.3499999999999996},"min":{"1min":1.1779999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":23.251999999999999,"5min":556.02599999999995,"15min":556.02599999999995},"last":4.5990000000000002},{"interface":"front","average":{"1min":2.1589999999999998,"5min":2.5870000000000002,"15min":3.4820000000000002},"min":{"1min":1.1120000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":4.931,"5min":18.196000000000002,"15min":18.196000000000002},"last":4.8799999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.319,"15min":3.524},"min":{"1min":1.399,"5min":1.175,"15min":1.175},"max":{"1min":6.5700000000000003,"5min":7.1479999999999997,"15min":18.446000000000002},"last":4.6799999999999997},{"interface":"front","average":{"1min":2.2999999999999998,"5min":2.6930000000000001,"15min":3.927},"min":{"1min":1.2270000000000001,"5min":1.1559999999999999,"15min":1.1559999999999999},"max":{"1min":5.0030000000000001,"5min":8.8900000000000006,"15min":19.318000000000001},"last":5.1509999999999998}]},{"osd":6,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":3.899,"5min":4.444,"15min":5.4000000000000004},"min":{"1min":1.708,"5min":1.48,"15min":1.48},"max":{"1min":12.815,"5min":17.027000000000001,"15min":24.981000000000002},"last":5.6429999999999998},{"interface":"front","average":{"1min":4.5549999999999997,"5min":15.795,"15min":9.0790000000000006},"min":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":23.866,"5min":589.55999999999995,"15min":589.55999999999995},"last":5.2809999999999997}]},{"osd":8,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.4950000000000001,"5min":2.5339999999999998,"15min":4.1159999999999997},"min":{"1min":1.5780000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"max":{"1min":6.7169999999999996,"5min":7.5510000000000002,"15min":18.579000000000001},"last":5.0049999999999999},{"interface":"front","average":{"1min":4.1360000000000001,"5min":13.949,"15min":7.7789999999999999},"min":{"1min":1.5449999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"max":{"1min":23.529,"5min":561.18200000000002,"15min":561.18200000000002},"last":4.835}]},{"osd":10,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":2.8679999999999999,"5min":3.0659999999999998,"15min":4.2679999999999998},"min":{"1min":1.369,"5min":1.286,"15min":1.286},"max":{"1min":9.2100000000000009,"5min":9.2100000000000009,"15min":19.547999999999998},"last":5.3810000000000002},{"interface":"front","average":{"1min":2.6659999999999999,"5min":2.6699999999999999,"15min":4.3769999999999998},"min":{"1min":1.8160000000000001,"5min":1.46,"15min":1.46},"max":{"1min":6.8659999999999997,"5min":7.6769999999999996,"15min":18.707000000000001},"last":5.4290000000000003}]},{"osd":11,"last update":"Fri Nov 20 12:22:15 2020","interfaces":[{"interface":"back","average":{"1min":4.2939999999999996,"5min":14.108000000000001,"15min":8.0500000000000007},"min":{"1min":1.7949999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"max":{"1min":23.658999999999999,"5min":561.32899999999995,"15min":561.32899999999995},"last":5.069},{"interface":"front","average":{"1min":2.609,"5min":3.1269999999999998,"15min":4.5359999999999996},"min":{"1min":1.5469999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"max":{"1min":5.181,"5min":12.641,"15min":19.780000000000001},"last":5.5739999999999998}]}]},{"osd":8,"up_from":17,"seq":73014444143,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":837260,"kb_used_data":92862120,"kb_used_omap":10854,"kb_used_meta":0,"kb_avail":92862120,"statfs":{"total":95948165120,"available":95090810880,"internally_reserved":0,"allocated":95090810880,"data_stored":95090810880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11115291,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7689999999999999,"5min":1.377,"15min":2.2229999999999999},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":19.047999999999998,"5min":19.047999999999998,"15min":197.74100000000001},"last":1.839},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.5109999999999999,"15min":2.4260000000000002},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":19.082999999999998,"5min":19.082999999999998,"15min":197.762},"last":1.651}]},{"osd":1,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.94999999999999996,"15min":1.0449999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2629999999999999,"5min":1.427,"15min":1.538},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.01,"15min":1.0760000000000001},"min":{"1min":0.61599999999999999,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.1359999999999999,"5min":1.748,"15min":1.748},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.77700000000000002,"15min":0.85999999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.1539999999999999,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.98099999999999998,"15min":1.0229999999999999},"min":{"1min":0.65900000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3859999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.29,"15min":1.5109999999999999},"min":{"1min":0.73399999999999999,"5min":0.71199999999999997,"15min":0.70699999999999996},"max":{"1min":5.8419999999999996,"5min":5.8419999999999996,"15min":5.8419999999999996},"last":1.716},{"interface":"front","average":{"1min":1.5,"5min":1.385,"15min":1.74},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":5.8940000000000001,"5min":5.8940000000000001,"15min":5.8940000000000001},"last":1.8700000000000001}]},{"osd":4,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.997,"15min":1.1479999999999999},"min":{"1min":0.67000000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.3300000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.163},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2709999999999999,"15min":1.339},"min":{"1min":0.88800000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":1.6559999999999999,"5min":1.764,"15min":1.764},"last":1.0980000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.4870000000000001,"15min":2.758},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.82199999999999995},"max":{"1min":2.5750000000000002,"5min":5.7619999999999996,"15min":278.42200000000003},"last":1.052},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.5860000000000001,"15min":2.8290000000000002},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.6619999999999999,"5min":5.8120000000000003,"15min":278.48700000000002},"last":1.4390000000000001}]},{"osd":7,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.264,"15min":1.278},"min":{"1min":0.85999999999999999,"5min":0.85099999999999998,"15min":0.79400000000000004},"max":{"1min":1.9139999999999999,"5min":3.3109999999999999,"15min":3.3109999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.3720000000000001,"15min":1.407},"min":{"1min":0.95599999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8120000000000001,"5min":3.3490000000000002,"15min":3.3490000000000002},"last":1.218}]},{"osd":9,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.671,"15min":4.7080000000000002},"min":{"1min":1.089,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.3100000000000001,"5min":5.7140000000000004,"15min":620.09000000000003},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.7709999999999999,"15min":1.827},"min":{"1min":1.113,"5min":1.113,"15min":1.113},"max":{"1min":3.1200000000000001,"5min":5.1639999999999997,"15min":5.1639999999999997},"last":1.546}]},{"osd":10,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3680000000000001,"15min":1.4870000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.827,"5min":1.9119999999999999,"15min":3.367},"last":1.353},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.3480000000000001,"15min":1.458},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.6299999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":1.302}]},{"osd":11,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.4510000000000001,"15min":1.5309999999999999},"min":{"1min":1.008,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.845,"5min":1.9530000000000001,"15min":2.2389999999999999},"last":1.194},{"interface":"front","average":{"1min":1.405,"5min":1.4550000000000001,"15min":1.5640000000000001},"min":{"1min":1.024,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":1.956,"5min":1.984,"15min":1.984},"last":1.4990000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444142,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":835160,"kb_used_data":92864220,"kb_used_omap":17980,"kb_used_meta":0,"kb_avail":92864220,"statfs":{"total":95948165120,"available":95092961280,"internally_reserved":0,"allocated":95092961280,"data_stored":95092961280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18411715,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.98399999999999999,"15min":1.232},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0369999999999999,"5min":3.6760000000000002,"15min":4.8239999999999998},"last":1.72},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.3779999999999999,"15min":1.494},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":3.7770000000000001,"5min":5.165,"15min":27.524999999999999},"last":2.1349999999999998}]},{"osd":1,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76900000000000002,"15min":0.81999999999999995},"min":{"1min":0.59199999999999997,"5min":0.58899999999999997,"15min":0.56000000000000005},"max":{"1min":0.97899999999999998,"5min":1.038,"15min":1.121},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.83399999999999996,"15min":0.871},"min":{"1min":0.60899999999999999,"5min":0.60599999999999998,"15min":0.59499999999999997},"max":{"1min":1.52,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.01,"15min":0.996},"min":{"1min":0.69099999999999995,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0429999999999999,"15min":1.1299999999999999},"min":{"1min":0.755,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.482,"5min":1.615,"15min":1.615},"last":1.103}]},{"osd":3,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3500000000000001,"15min":1.548},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.74199999999999999},"max":{"1min":2.0600000000000001,"5min":5.0149999999999997,"15min":5.0149999999999997},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.3200000000000001,"15min":1.468},"min":{"1min":0.91700000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"max":{"1min":2.2240000000000002,"5min":3.254,"15min":3.254},"last":1.5900000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.163,"15min":1.228},"min":{"1min":0.83099999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.571,"5min":1.744,"15min":1.744},"last":1.256},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.2589999999999999,"15min":1.27},"min":{"1min":1.0389999999999999,"5min":0.85899999999999999,"15min":0.81100000000000005},"max":{"1min":1.8129999999999999,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.1619999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5049999999999999,"15min":1.706},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.85799999999999998},"max":{"1min":2.4020000000000001,"5min":4.54,"15min":13.116},"last":1.867},{"interface":"front","average":{"1min":1.51,"5min":1.677,"15min":1.917},"min":{"1min":1.0940000000000001,"5min":0.871,"15min":0.871},"max":{"1min":3.9020000000000001,"5min":13.208,"15min":26.581},"last":1.752}]},{"osd":8,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.429,"15min":1.4790000000000001},"min":{"1min":1.1759999999999999,"5min":1.008,"15min":0.88100000000000001},"max":{"1min":2.069,"5min":2.1539999999999999,"15min":2.1709999999999998},"last":1.296},{"interface":"front","average":{"1min":1.498,"5min":1.417,"15min":1.4299999999999999},"min":{"1min":0.98799999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":2.0070000000000001,"5min":2.04,"15min":2.1309999999999998},"last":1.1910000000000001}]},{"osd":9,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.8009999999999999,"15min":2.2839999999999998},"min":{"1min":1.22,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.849,"5min":4.9180000000000001,"15min":71.325999999999993},"last":1.895},{"interface":"front","average":{"1min":1.708,"5min":1.9179999999999999,"15min":2.3610000000000002},"min":{"1min":1.4219999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"max":{"1min":2.2949999999999999,"5min":4.9429999999999996,"15min":69.656999999999996},"last":2.2690000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.458,"15min":1.5},"min":{"1min":1.0009999999999999,"5min":0.99199999999999999,"15min":0.78100000000000003},"max":{"1min":2.2709999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.4139999999999999,"15min":1.476},"min":{"1min":1.127,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.9510000000000001,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.399}]},{"osd":11,"last update":"Fri Nov 20 12:22:14 2020","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.544,"15min":1.643},"min":{"1min":1.2290000000000001,"5min":1.125,"15min":0.97099999999999997},"max":{"1min":2.181,"5min":2.371,"15min":2.7469999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.611,"5min":1.5620000000000001,"15min":1.6419999999999999},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":0.92600000000000005},"max":{"1min":2.1509999999999998,"5min":2.3359999999999999,"15min":2.3359999999999999},"last":1.4770000000000001}]}]},{"osd":6,"up_from":17,"seq":73014444141,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":847284,"kb_used_data":92852096,"kb_used_omap":21334,"kb_used_meta":0,"kb_avail":92852096,"statfs":{"total":95948165120,"available":95080546304,"internally_reserved":0,"allocated":95080546304,"data_stored":95080546304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21846556,"internal_metadata":0},"hb_peers":[0,1,2,3,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":3.0150000000000001,"15min":2.8370000000000002},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.8839999999999999,"5min":11.977,"15min":55.573999999999998},"last":2.194},{"interface":"front","average":{"1min":2.0169999999999999,"5min":3.988,"15min":4.0449999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":5.7679999999999998,"5min":66.028999999999996,"15min":147.11099999999999},"last":4.1050000000000004}]},{"osd":1,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":2.5640000000000001,"15min":2.964},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":4.4379999999999997,"5min":52.729999999999997,"15min":106.60899999999999},"last":2.3879999999999999},{"interface":"front","average":{"1min":1.9850000000000001,"5min":2.1320000000000001,"15min":3.0459999999999998},"min":{"1min":0.77100000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":5.1500000000000004,"5min":15.574999999999999,"15min":104.149},"last":2.294}]},{"osd":2,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.1669999999999998,"5min":2.899,"15min":3.4159999999999999},"min":{"1min":0.83999999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":4.742,"5min":65.375,"15min":106.741},"last":2.7429999999999999},{"interface":"front","average":{"1min":2.4950000000000001,"5min":2.4049999999999998,"15min":3.5110000000000001},"min":{"1min":1.018,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":6.1790000000000003,"5min":15.702999999999999,"15min":104.271},"last":2.4670000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8340000000000001,"5min":3.6699999999999999,"15min":4.3979999999999997},"min":{"1min":1.3300000000000001,"5min":0.97699999999999998,"15min":0.81799999999999995},"max":{"1min":6.577,"5min":15.83,"15min":104.387},"last":2.9329999999999998},{"interface":"front","average":{"1min":2.2320000000000002,"5min":3.4670000000000001,"15min":3.6509999999999998},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":5.5469999999999997,"5min":8.0630000000000006,"15min":55.439999999999998},"last":5.0810000000000004}]},{"osd":5,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.0350000000000001,"5min":2.4449999999999998,"15min":3.1139999999999999},"min":{"1min":1.1759999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":4.1139999999999999,"5min":9.1310000000000002,"15min":55.796999999999997},"last":3.673},{"interface":"front","average":{"1min":2.419,"5min":3.2970000000000002,"15min":4.008},"min":{"1min":1.1020000000000001,"5min":1.0349999999999999,"15min":1.0249999999999999},"max":{"1min":4.6189999999999998,"5min":65.503,"15min":106.861},"last":4.3479999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.9220000000000002,"5min":2.7130000000000001,"15min":4.1859999999999999},"min":{"1min":1.5309999999999999,"5min":1.0469999999999999,"15min":0.81399999999999995},"max":{"1min":6.3940000000000001,"5min":16.32,"15min":113.36799999999999},"last":3.077},{"interface":"front","average":{"1min":2.2250000000000001,"5min":2.5110000000000001,"15min":3.3540000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":4.4950000000000001,"5min":8.202,"15min":55.915999999999997},"last":4.2519999999999998}]},{"osd":8,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6360000000000001,"5min":3.5190000000000001,"15min":4.6059999999999999},"min":{"1min":1.3640000000000001,"5min":1.1279999999999999,"15min":1.1279999999999999},"max":{"1min":4.8659999999999997,"5min":65.617000000000004,"15min":107.164},"last":4.5620000000000003},{"interface":"front","average":{"1min":3.0880000000000001,"5min":3.0150000000000001,"15min":4.5259999999999998},"min":{"1min":1.4059999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":7.0090000000000003,"5min":16.451000000000001,"15min":113.634},"last":3.3530000000000002}]},{"osd":9,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.891,"5min":5.0439999999999996,"15min":6.9560000000000004},"min":{"1min":1.526,"5min":1.526,"15min":1.526},"max":{"1min":5.8920000000000003,"5min":83.903000000000006,"15min":466.512},"last":5.4509999999999996},{"interface":"front","average":{"1min":3.0289999999999999,"5min":5.1369999999999996,"15min":5.7519999999999998},"min":{"1min":1.498,"5min":1.498,"15min":1.498},"max":{"1min":5.0010000000000003,"5min":65.837999999999994,"15min":107.398},"last":4.992}]},{"osd":10,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":3.302,"5min":3.4569999999999999,"15min":4.8300000000000001},"min":{"1min":1.7689999999999999,"5min":1.383,"15min":1.2330000000000001},"max":{"1min":6.7720000000000002,"5min":36.499000000000002,"15min":113.506},"last":3.2040000000000002},{"interface":"front","average":{"1min":2.5510000000000002,"5min":2.7989999999999999,"15min":3.8330000000000002},"min":{"1min":1.452,"5min":1.224,"15min":1.224},"max":{"1min":5.218,"5min":8.9109999999999996,"15min":56.043999999999997},"last":4.6699999999999999}]},{"osd":11,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8340000000000001,"5min":3.6269999999999998,"15min":4.9589999999999996},"min":{"1min":1.7529999999999999,"5min":1.425,"15min":1.425},"max":{"1min":5.1470000000000002,"5min":65.727999999999994,"15min":107.282},"last":4.7549999999999999},{"interface":"front","average":{"1min":3.423,"5min":3.569,"15min":5.0519999999999996},"min":{"1min":1.8200000000000001,"5min":1.411,"15min":1.411},"max":{"1min":7.2409999999999997,"5min":36.649000000000001,"15min":113.756},"last":3.5190000000000001}]}]},{"osd":1,"up_from":17,"seq":73014444142,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796424,"kb_used_data":92902956,"kb_used_omap":6349,"kb_used_meta":0,"kb_avail":92902956,"statfs":{"total":95948165120,"available":95132626944,"internally_reserved":0,"allocated":95132626944,"data_stored":95132626944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6501384,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.5429999999999999,"15min":2.6240000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.0600000000000001,"5min":30.274999999999999,"15min":283.54199999999997},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.673,"15min":2.6739999999999999},"min":{"1min":0.83599999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.992,"5min":30.335000000000001,"15min":283.51499999999999},"last":1.2090000000000001}]},{"osd":2,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":1.02,"15min":1.0429999999999999},"min":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.335,"5min":1.6830000000000001,"15min":1.6830000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.93000000000000005,"15min":0.98899999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.393,"5min":2.149,"15min":2.149},"last":1.3100000000000001}]},{"osd":3,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.375,"15min":1.6419999999999999},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5820000000000001,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":1.95},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.4690000000000001,"15min":1.6839999999999999},"min":{"1min":1,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.085,"5min":4.4560000000000004,"15min":4.4560000000000004},"last":1.833}]},{"osd":4,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0269999999999999,"15min":1.075},"min":{"1min":0.76700000000000002,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4610000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.167},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.052,"15min":1.0640000000000001},"min":{"1min":0.78200000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.512,"5min":8.7349999999999994,"15min":8.7349999999999994},"last":0.89000000000000001}]},{"osd":5,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.96899999999999997,"15min":0.998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1140000000000001,"5min":4.4779999999999998,"15min":4.4779999999999998},"last":1.234},{"interface":"front","average":{"1min":1.292,"5min":1.4059999999999999,"15min":1.431},"min":{"1min":0.97899999999999998,"5min":0.93400000000000005,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.6679999999999999}]},{"osd":6,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":4.8630000000000004,"15min":2.839},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.86599999999999999},"max":{"1min":7.0330000000000004,"5min":280.65300000000002,"15min":280.65300000000002},"last":1.639},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.6359999999999999,"15min":1.603},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":6.984,"5min":13.917999999999999,"15min":13.917999999999999},"last":1.903}]},{"osd":7,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4630000000000001,"15min":1.4450000000000001},"min":{"1min":0.91100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.1419999999999999,"5min":2.9279999999999999,"15min":2.9279999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.373,"15min":1.3819999999999999},"min":{"1min":0.85099999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.7809999999999999,"5min":3.1379999999999999,"15min":3.1379999999999999},"last":1.3939999999999999}]},{"osd":8,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1879999999999999,"15min":1.2290000000000001},"min":{"1min":0.78900000000000003,"5min":0.748,"15min":0.748},"max":{"1min":1.3919999999999999,"5min":4.6109999999999998,"15min":4.6109999999999998},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5900000000000001,"15min":1.629},"min":{"1min":1.046,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":1.8220000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":1.7989999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4810000000000001,"5min":1.6990000000000001,"15min":1.8080000000000001},"min":{"1min":1.228,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.3759999999999999,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.901,"5min":8.3670000000000009,"15min":6.7709999999999999},"min":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"max":{"1min":5.2939999999999996,"5min":500.98700000000002,"15min":743.49599999999998},"last":2.1150000000000002}]},{"osd":11,"last update":"Fri Nov 20 12:22:16 2020","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.5609999999999999,"15min":1.5660000000000001},"min":{"1min":1.1000000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"max":{"1min":1.7549999999999999,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.482},{"interface":"front","average":{"1min":1.232,"5min":1.389,"15min":1.468},"min":{"1min":1.0489999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.3660000000000001,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.339}]}]},{"osd":0,"up_from":17,"seq":73014444141,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":797356,"kb_used_data":92902024,"kb_used_omap":12641,"kb_used_meta":0,"kb_avail":92902024,"statfs":{"total":95948165120,"available":95131672576,"internally_reserved":0,"allocated":95131672576,"data_stored":95131672576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12944847,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.0390000000000001,"5min":4.6180000000000003,"15min":2.9340000000000002},"min":{"1min":0.749,"5min":0.747,"15min":0.747},"max":{"1min":3.6989999999999998,"5min":160.18899999999999,"15min":160.18899999999999},"last":3.5779999999999998},{"interface":"front","average":{"1min":1.893,"5min":1.952,"15min":2.0169999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.9569999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":2.2080000000000002}]},{"osd":2,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":2.3090000000000002,"15min":2.2360000000000002},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":3.54,"5min":61.881999999999998,"15min":61.881999999999998},"last":2.0409999999999999},{"interface":"front","average":{"1min":2.5289999999999999,"5min":5.0670000000000002,"15min":4.6760000000000002},"min":{"1min":1.1699999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":4.4809999999999999,"5min":160.33099999999999,"15min":272.47399999999999},"last":2.1059999999999999}]},{"osd":3,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7759999999999998,"5min":5.6790000000000003,"15min":5.3259999999999996},"min":{"1min":1.5289999999999999,"5min":0.94299999999999995,"15min":0.93100000000000005},"max":{"1min":4.2160000000000002,"5min":160.45599999999999,"15min":272.67399999999998},"last":3.9780000000000002},{"interface":"front","average":{"1min":2.355,"5min":3.5009999999999999,"15min":3.504},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":4.6989999999999998,"5min":62.017000000000003,"15min":62.017000000000003},"last":3.5139999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.9089999999999998,"5min":5.226,"15min":5.1689999999999996},"min":{"1min":1.3540000000000001,"5min":1.0840000000000001,"15min":1.0620000000000001},"max":{"1min":4.6680000000000001,"5min":160.58099999999999,"15min":272.84399999999999},"last":4.4500000000000002},{"interface":"front","average":{"1min":2.4239999999999999,"5min":2.2480000000000002,"15min":3.6139999999999999},"min":{"1min":1.204,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":4.3029999999999999,"5min":6.6749999999999998,"15min":265.32100000000003},"last":2.6219999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.4729999999999999,"5min":2.8650000000000002,"15min":4.3259999999999996},"min":{"1min":1.083,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":4.8449999999999998,"5min":62.151000000000003,"15min":267.30000000000001},"last":3.75},{"interface":"front","average":{"1min":3.069,"5min":5.6040000000000001,"15min":5.5529999999999999},"min":{"1min":1.496,"5min":1.2270000000000001,"15min":1.2270000000000001},"max":{"1min":5.1159999999999997,"5min":178.53999999999999,"15min":273.16199999999998},"last":4.8200000000000003}]},{"osd":6,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.3239999999999998,"5min":3.4380000000000002,"15min":4.6260000000000003},"min":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"max":{"1min":6.1829999999999998,"5min":10.782999999999999,"15min":266.46699999999998},"last":4.0629999999999997},{"interface":"front","average":{"1min":3.0920000000000001,"5min":6.827,"15min":6.2300000000000004},"min":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"max":{"1min":5.524,"5min":219.703,"15min":266.62599999999998},"last":4.5529999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.2549999999999999,"5min":5.8170000000000002,"15min":5.7709999999999999},"min":{"1min":1.6839999999999999,"5min":1.5229999999999999,"15min":1.3180000000000001},"max":{"1min":5.4619999999999997,"5min":178.80699999999999,"15min":273.00400000000002},"last":5.202},{"interface":"front","average":{"1min":2.6890000000000001,"5min":2.5299999999999998,"15min":4.0739999999999998},"min":{"1min":1.452,"5min":1.2390000000000001,"15min":1.2390000000000001},"max":{"1min":4.3360000000000003,"5min":5.5590000000000002,"15min":266.05900000000003},"last":3.8210000000000002}]},{"osd":8,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.8100000000000001,"5min":3.1720000000000002,"15min":4.7800000000000002},"min":{"1min":1.3859999999999999,"5min":1.137,"15min":1.137},"max":{"1min":5.1239999999999997,"5min":62.274999999999999,"15min":267.91699999999997},"last":4.1189999999999998},{"interface":"front","average":{"1min":3.4510000000000001,"5min":6.0700000000000003,"15min":6.0590000000000002},"min":{"1min":1.8440000000000001,"5min":1.6359999999999999,"15min":1.5880000000000001},"max":{"1min":5.6970000000000001,"5min":178.68000000000001,"15min":273.33199999999999},"last":5.6189999999999998}]},{"osd":10,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7599999999999998,"5min":2.661,"15min":4.3090000000000002},"min":{"1min":1.575,"5min":1.3660000000000001,"15min":1.3660000000000001},"max":{"1min":4.4400000000000004,"5min":5.6900000000000004,"15min":265.68799999999999},"last":4.2800000000000002},{"interface":"front","average":{"1min":3.0379999999999998,"5min":3.327,"15min":5.0090000000000003},"min":{"1min":1.53,"5min":1.4330000000000001,"15min":1.4330000000000001},"max":{"1min":5.8220000000000001,"5min":62.399000000000001,"15min":267.00299999999999},"last":4.3390000000000004}]},{"osd":11,"last update":"Fri Nov 20 12:22:10 2020","interfaces":[{"interface":"back","average":{"1min":3.556,"5min":6.2549999999999999,"15min":6.3010000000000002},"min":{"1min":1.9870000000000001,"5min":1.76,"15min":1.712},"max":{"1min":5.8940000000000001,"5min":178.94300000000001,"15min":273.65899999999999},"last":5.9969999999999999},{"interface":"front","average":{"1min":3.157,"5min":3.4689999999999999,"15min":5.2430000000000003},"min":{"1min":1.6220000000000001,"5min":1.403,"15min":1.403},"max":{"1min":6.202,"5min":62.533999999999999,"15min":267.61099999999999},"last":4.7549999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444141,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":796556,"kb_used_data":92902824,"kb_used_omap":6358,"kb_used_meta":0,"kb_avail":92902824,"statfs":{"total":95948165120,"available":95132491776,"internally_reserved":0,"allocated":95132491776,"data_stored":95132491776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6511083,"internal_metadata":0},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.89000000000000001,"15min":0.88800000000000001},"min":{"1min":0.626,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2749999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.91500000000000004,"15min":0.95699999999999996},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2310000000000001,"5min":1.764,"15min":1.764},"last":0.79800000000000004}]},{"osd":3,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.1699999999999999,"15min":1.4690000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.552,"5min":6.1600000000000001,"15min":6.9889999999999999},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.105,"5min":1.23,"15min":1.528},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.548,"5min":3.6099999999999999,"15min":7.2889999999999997},"last":1.641}]},{"osd":4,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.93899999999999995,"15min":1.1399999999999999},"min":{"1min":0.64900000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0860000000000001,"5min":1.4510000000000001,"15min":6.867},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.093,"15min":1.1399999999999999},"min":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.423,"5min":1.917,"15min":1.917},"last":1.0129999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95499999999999996,"15min":0.98399999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.381,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.079,"5min":1.0489999999999999,"15min":1.1890000000000001},"min":{"1min":0.72799999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":6.7140000000000004},"last":1.109}]},{"osd":6,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":3.302,"15min":2.3639999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.8049999999999999,"5min":122.973,"15min":122.973},"last":1.431},{"interface":"front","average":{"1min":1.417,"5min":1.5669999999999999,"15min":1.6910000000000001},"min":{"1min":0.94699999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":3.105,"5min":12.023999999999999,"15min":12.023999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3169999999999999,"15min":1.3340000000000001},"min":{"1min":1.0249999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.171},{"interface":"front","average":{"1min":1.288,"5min":1.335,"15min":1.329},"min":{"1min":1.002,"5min":0.872,"15min":0.84599999999999997},"max":{"1min":2.1720000000000002,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.206}]},{"osd":8,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3759999999999999,"15min":1.415},"min":{"1min":0.91500000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.806,"5min":2.302,"15min":2.302},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.4390000000000001,"15min":1.458},"min":{"1min":1.0389999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.8169999999999999,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.323}]},{"osd":9,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.8959999999999999,"5min":7.1989999999999998,"15min":5.1559999999999997},"min":{"1min":1.2350000000000001,"5min":1.087,"15min":1.087},"max":{"1min":6.1680000000000001,"5min":378.10700000000003,"15min":378.10700000000003},"last":1.621},{"interface":"front","average":{"1min":1.9259999999999999,"5min":7.2750000000000004,"15min":5.3019999999999996},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":6.1189999999999998,"5min":378.18599999999998,"15min":378.18599999999998},"last":2.0390000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.593,"15min":1.7629999999999999},"min":{"1min":1.121,"5min":1.1200000000000001,"15min":1.1200000000000001},"max":{"1min":1.948,"5min":4.8609999999999998,"15min":6.8940000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.5269999999999999,"15min":1.677},"min":{"1min":1.161,"5min":1.04,"15min":0.99099999999999999},"max":{"1min":2.1389999999999998,"5min":4.8399999999999999,"15min":7.9790000000000001},"last":1.274}]},{"osd":11,"last update":"Fri Nov 20 12:22:11 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.609,"15min":1.794},"min":{"1min":1.236,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.3130000000000002,"5min":2.4220000000000002,"15min":6.9619999999999997},"last":1.7749999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.6319999999999999,"15min":1.679},"min":{"1min":1.264,"5min":1.1319999999999999,"15min":1.1319999999999999},"max":{"1min":2.343,"5min":2.343,"15min":2.343},"last":1.5189999999999999}]}]},{"osd":3,"up_from":17,"seq":73014444141,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":858476,"kb_used_data":92840904,"kb_used_omap":8925,"kb_used_meta":0,"kb_avail":92840904,"statfs":{"total":95948165120,"available":95069085696,"internally_reserved":0,"allocated":95069085696,"data_stored":95069085696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9139693,"internal_metadata":0},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":2.1059999999999999,"15min":2.012},"min":{"1min":0.78700000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":2.552,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":1.7390000000000001},{"interface":"front","average":{"1min":2.0230000000000001,"5min":2.4620000000000002,"15min":2.1589999999999998},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":3.694,"5min":6.9100000000000001,"15min":6.9100000000000001},"last":1.8899999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.6220000000000001,"15min":1.9910000000000001},"min":{"1min":0.83199999999999996,"5min":0.745,"15min":0.745},"max":{"1min":4.2759999999999998,"5min":5.4539999999999997,"15min":5.7859999999999996},"last":1.8180000000000001},{"interface":"front","average":{"1min":2.3069999999999999,"5min":2.2570000000000001,"15min":2.847},"min":{"1min":1.4239999999999999,"5min":0.879,"15min":0.879},"max":{"1min":4.0759999999999996,"5min":6.6680000000000001,"15min":6.6680000000000001},"last":2.2759999999999998}]},{"osd":4,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.4940000000000002,"5min":2.7429999999999999,"15min":2.827},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.91900000000000004},"max":{"1min":3.6869999999999998,"5min":7.2699999999999996,"15min":7.2699999999999996},"last":3.456},{"interface":"front","average":{"1min":1.9550000000000001,"5min":1.8009999999999999,"15min":2.3260000000000001},"min":{"1min":1.0069999999999999,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":5.0220000000000002,"5min":5.0220000000000002,"15min":5.9189999999999996},"last":2.8959999999999999}]},{"osd":5,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6659999999999999,"5min":2.5630000000000002,"15min":3.2599999999999998},"min":{"1min":1.6619999999999999,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":4.407,"5min":6.7960000000000003,"15min":6.7960000000000003},"last":2.8109999999999999},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.9670000000000001,"15min":3.2629999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":4.5839999999999996,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":3.7930000000000001}]},{"osd":6,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":4.2519999999999998,"15min":3.9100000000000001},"min":{"1min":1.214,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":5.1479999999999997,"5min":44.954000000000001,"15min":44.954000000000001},"last":3.9449999999999998},{"interface":"front","average":{"1min":3.2869999999999999,"5min":4.6079999999999997,"15min":4.4809999999999999},"min":{"1min":1.9119999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"max":{"1min":5.891,"5min":23.939,"15min":23.939},"last":3.5529999999999999}]},{"osd":7,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":3.2149999999999999,"15min":3.5219999999999998},"min":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.429},"max":{"1min":4.2679999999999998,"5min":8.7919999999999998,"15min":8.7919999999999998},"last":3.9980000000000002},{"interface":"front","average":{"1min":2.4129999999999998,"5min":2.2269999999999999,"15min":3.0209999999999999},"min":{"1min":1.3939999999999999,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":5.2800000000000002,"5min":5.5839999999999996,"15min":5.5839999999999996},"last":3.3290000000000002}]},{"osd":8,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":2.7890000000000001,"15min":3.633},"min":{"1min":1.97,"5min":1.49,"15min":1.49},"max":{"1min":5.1580000000000004,"5min":7.0430000000000001,"15min":7.0430000000000001},"last":2.4830000000000001},{"interface":"front","average":{"1min":3.0489999999999999,"5min":3.3149999999999999,"15min":3.7069999999999999},"min":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"max":{"1min":5.1150000000000002,"5min":8.6669999999999998,"15min":8.6669999999999998},"last":4.1989999999999998}]},{"osd":9,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.6520000000000001,"5min":4.7000000000000002,"15min":4.891},"min":{"1min":2.274,"5min":1.9910000000000001,"15min":1.9910000000000001},"max":{"1min":6.3220000000000001,"5min":14.824999999999999,"15min":14.824999999999999},"last":3.6840000000000002},{"interface":"front","average":{"1min":3.8820000000000001,"5min":4.7560000000000002,"15min":4.6689999999999996},"min":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"max":{"1min":6.1459999999999999,"5min":12.275,"15min":12.275},"last":4.4450000000000003}]},{"osd":10,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.194,"5min":2.9900000000000002,"15min":3.988},"min":{"1min":2.0209999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"max":{"1min":5.9359999999999999,"5min":7.5350000000000001,"15min":7.5350000000000001},"last":2.6349999999999998},{"interface":"front","average":{"1min":2.5209999999999999,"5min":2.2629999999999999,"15min":3.1749999999999998},"min":{"1min":1.387,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":5.4320000000000004,"5min":5.5309999999999997,"15min":6.1890000000000001},"last":3.7240000000000002}]},{"osd":11,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":3.3199999999999998,"5min":3.5009999999999999,"15min":4.077},"min":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"max":{"1min":5.3310000000000004,"5min":6.6989999999999998,"15min":6.6989999999999998},"last":4.6289999999999996},{"interface":"front","average":{"1min":3.3410000000000002,"5min":3.109,"15min":4.2320000000000002},"min":{"1min":2.226,"5min":1.6319999999999999,"15min":1.6319999999999999},"max":{"1min":6.3250000000000002,"5min":7.4130000000000003,"15min":7.4130000000000003},"last":3.2290000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444143,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":911364,"kb_used_data":92788016,"kb_used_omap":32361,"kb_used_meta":0,"kb_avail":92788016,"statfs":{"total":95948165120,"available":95014928384,"internally_reserved":0,"allocated":95014928384,"data_stored":95014928384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33138500,"internal_metadata":0},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.716,"15min":1.5760000000000001},"min":{"1min":0.68500000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.9039999999999999,"5min":38.838000000000001,"15min":38.838000000000001},"last":2.0640000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.2569999999999999,"15min":1.6100000000000001},"min":{"1min":0.74099999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.6619999999999999,"5min":5.6539999999999999,"15min":8.3780000000000001},"last":2.0030000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84199999999999997,"15min":0.90800000000000003},"min":{"1min":0.66100000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.302},{"interface":"front","average":{"1min":1.077,"5min":1.038,"15min":1.048},"min":{"1min":0.71399999999999997,"5min":0.628,"15min":0.628},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.089}]},{"osd":3,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2689999999999999,"15min":1.546},"min":{"1min":0.71399999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0219999999999998,"5min":4.298,"15min":4.298},"last":1.216},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.258,"15min":1.871},"min":{"1min":0.86199999999999999,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":2.226,"5min":3.5880000000000001,"15min":8.8209999999999997},"last":1.712}]},{"osd":5,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":1.145,"15min":1.2470000000000001},"min":{"1min":0.68300000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.573,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.413},{"interface":"front","average":{"1min":1.038,"5min":1.109,"15min":1.1140000000000001},"min":{"1min":0.67600000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.897,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":1.345}]},{"osd":6,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.498,"15min":1.5449999999999999},"min":{"1min":0.85799999999999998,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.274,"5min":4.1840000000000002,"15min":5.4100000000000001},"last":1.911},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.7410000000000001,"15min":1.8939999999999999},"min":{"1min":0.95399999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":2.923,"5min":21.384,"15min":21.384},"last":1.863}]},{"osd":7,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3180000000000001,"15min":1.3440000000000001},"min":{"1min":1.038,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0609999999999999,"5min":3.4780000000000002,"15min":3.4780000000000002},"last":1.266},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3340000000000001,"15min":1.53},"min":{"1min":0.76600000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.141,"5min":4.4390000000000001,"15min":8.6620000000000008},"last":1.135}]},{"osd":8,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2829999999999999,"15min":1.395},"min":{"1min":0.88100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.04,"5min":3.6949999999999998,"15min":3.6949999999999998},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.514,"15min":1.5920000000000001},"min":{"1min":1.1519999999999999,"5min":1.081,"15min":1.081},"max":{"1min":2.1909999999999998,"5min":3.6080000000000001,"15min":3.6080000000000001},"last":1.6299999999999999}]},{"osd":9,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.7490000000000001,"5min":2.0190000000000001,"15min":2.157},"min":{"1min":1.232,"5min":1.113,"15min":1.113},"max":{"1min":2.927,"5min":9.2119999999999997,"15min":9.2119999999999997},"last":1.825},{"interface":"front","average":{"1min":1.8360000000000001,"5min":8.0169999999999995,"15min":5.3040000000000003},"min":{"1min":1.181,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":4.8109999999999999,"5min":310.995,"15min":332.43700000000001},"last":2.0230000000000001}]},{"osd":10,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.625,"15min":1.9119999999999999},"min":{"1min":1.2549999999999999,"5min":1.143,"15min":1.143},"max":{"1min":2.5369999999999999,"5min":3.9380000000000002,"15min":8.2669999999999995},"last":1.776},{"interface":"front","average":{"1min":1.542,"5min":1.603,"15min":1.587},"min":{"1min":1.224,"5min":1.044,"15min":1.044},"max":{"1min":2.7250000000000001,"5min":4.6820000000000004,"15min":4.6820000000000004},"last":1.4570000000000001}]},{"osd":11,"last update":"Fri Nov 20 12:22:12 2020","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4830000000000001,"15min":1.6160000000000001},"min":{"1min":1.115,"5min":1.018,"15min":1.018},"max":{"1min":2.7189999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":2.157},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.6839999999999999,"15min":1.9970000000000001},"min":{"1min":1.351,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":2.4289999999999998,"5min":3.8079999999999998,"15min":8.4329999999999998},"last":1.9390000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444142,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":839492,"kb_used_data":92859888,"kb_used_omap":17255,"kb_used_meta":0,"kb_avail":92859888,"statfs":{"total":95948165120,"available":95088525312,"internally_reserved":0,"allocated":95088525312,"data_stored":95088525312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17669267,"internal_metadata":0},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.252,"15min":1.486},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.9750000000000001,"5min":6.4859999999999998,"15min":7.1699999999999999},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.153,"15min":1.319},"min":{"1min":0.65600000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":8.7669999999999995},"last":1.2490000000000001}]},{"osd":1,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.0029999999999999,"15min":1.036},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.1619999999999999,"5min":1.532,"15min":1.613},"last":1.103},{"interface":"front","average":{"1min":1.01,"5min":0.96799999999999997,"15min":0.98699999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.63600000000000001},"max":{"1min":4.3010000000000002,"5min":4.3010000000000002,"15min":4.3010000000000002},"last":1.0289999999999999}]},{"osd":2,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.623,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.294,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.876,"5min":0.96299999999999997,"15min":0.97699999999999998},"min":{"1min":0.61699999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.3680000000000001,"5min":1.4890000000000001,"15min":1.5680000000000001},"last":0.84199999999999997}]},{"osd":4,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.085,"15min":1.1279999999999999},"min":{"1min":0.66400000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":4.8529999999999998,"5min":4.8529999999999998,"15min":4.8529999999999998},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.1899999999999999,"15min":1.2909999999999999},"min":{"1min":0.90900000000000003,"5min":0.879,"15min":0.879},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":3.3900000000000001},"last":1.337}]},{"osd":6,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.696,"15min":1.702},"min":{"1min":1.006,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":5.2489999999999997,"5min":8.6760000000000002,"15min":8.6760000000000002},"last":1.7829999999999999},{"interface":"front","average":{"1min":1.835,"5min":1.7869999999999999,"15min":1.8340000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":6.5019999999999998,"5min":8.7279999999999998,"15min":8.7279999999999998},"last":2.1309999999999998}]},{"osd":7,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3400000000000001,"15min":1.3500000000000001},"min":{"1min":1.038,"5min":0.92900000000000005,"15min":0.86899999999999999},"max":{"1min":2.0379999999999998,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.198},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.377,"15min":1.429},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":0.98899999999999999},"max":{"1min":1.5289999999999999,"5min":1.911,"15min":2.3690000000000002},"last":1.387}]},{"osd":8,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.248,"15min":1.27},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":4.944,"5min":4.944,"15min":4.944},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.486,"15min":1.53},"min":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.054},"max":{"1min":2.1680000000000001,"5min":2.254,"15min":2.254},"last":1.506}]},{"osd":9,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5640000000000001,"5min":1.8460000000000001,"15min":2.0179999999999998},"min":{"1min":1.177,"5min":1.177,"15min":1.177},"max":{"1min":2.5129999999999999,"5min":5.7599999999999998,"15min":5.7599999999999998},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.7,"5min":1.821,"15min":1.946},"min":{"1min":1.077,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":5.0780000000000003,"5min":5.7930000000000001,"15min":5.7930000000000001},"last":1.6739999999999999}]},{"osd":10,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.5760000000000001,"15min":1.6439999999999999},"min":{"1min":1.2869999999999999,"5min":1.23,"15min":1.23},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.579},{"interface":"front","average":{"1min":1.413,"5min":1.52,"15min":1.589},"min":{"1min":1.105,"5min":1.105,"15min":1.052},"max":{"1min":1.7450000000000001,"5min":2.0299999999999998,"15min":2.3719999999999999},"last":1.524}]},{"osd":11,"last update":"Fri Nov 20 12:22:09 2020","interfaces":[{"interface":"back","average":{"1min":1.5569999999999999,"5min":1.5209999999999999,"15min":1.532},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":5.016,"5min":5.016,"15min":5.016},"last":1.29},{"interface":"front","average":{"1min":1.6120000000000001,"5min":1.6779999999999999,"15min":1.7450000000000001},"min":{"1min":1.29,"5min":1.29,"15min":1.29},"max":{"1min":2.2599999999999998,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.696}]}]}]}} 2020-11-20T12:22:57.449 INFO:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2020-11-20T12:22:57.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.647+0000 7f0ca50fc700 1 Processor -- start 2020-11-20T12:22:57.650 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.647+0000 7f0ca50fc700 1 -- start start 2020-11-20T12:22:57.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.648+0000 7f0ca50fc700 1 --2- >> v2:172.21.15.134:3300/0 conn(0x7f0ca00bf720 0x7f0ca00bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0ca50fc700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0ca00c2070 0x7f0ca01514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.652 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0ca50fc700 1 -- --> v1:172.21.15.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00c25b0 con 0x7f0ca01519a0 2020-11-20T12:22:57.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0ca50fc700 1 -- --> v2:172.21.15.134:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca0151e20 con 0x7f0ca00bf720 2020-11-20T12:22:57.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0ca50fc700 1 -- --> v2:172.21.15.160:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca00c2850 con 0x7f0ca00c2070 2020-11-20T12:22:57.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0c9f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0ca00c2070 0x7f0ca01514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.653 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0c9f7fe700 1 --2- >> v2:172.21.15.160:3300/0 conn(0x7f0ca00c2070 0x7f0ca01514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:39010/0 (socket says 172.21.15.160:39010) 2020-11-20T12:22:57.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0c9f7fe700 1 -- 172.21.15.160:0/1636054292 learned_addr learned my addr 172.21.15.160:0/1636054292 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:57.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0ca48fb700 1 --1- 172.21.15.160:0/1636054292 >> v1:172.21.15.160:6789/0 conn(0x7f0ca01519a0 0x7f0ca0154780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.160:6789/0 says I am v1:172.21.15.160:56588/0 (socket says 172.21.15.160:56588) 2020-11-20T12:22:57.654 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.649+0000 7f0c9ffff700 1 --2- 172.21.15.160:0/1636054292 >> v2:172.21.15.134:3300/0 conn(0x7f0ca00bf720 0x7f0ca00bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9f7fe700 1 -- 172.21.15.160:0/1636054292 >> v2:172.21.15.134:3300/0 conn(0x7f0ca00bf720 msgr2=0x7f0ca00bfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:22:57.657 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9f7fe700 1 --2- 172.21.15.160:0/1636054292 >> v2:172.21.15.134:3300/0 conn(0x7f0ca00bf720 0x7f0ca00bfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9f7fe700 1 -- 172.21.15.160:0/1636054292 >> v1:172.21.15.160:6789/0 conn(0x7f0ca01519a0 legacy=0x7f0ca0154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9f7fe700 1 -- 172.21.15.160:0/1636054292 --> v2:172.21.15.160:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00c2af0 con 0x7f0ca00c2070 2020-11-20T12:22:57.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9ffff700 1 --2- 172.21.15.160:0/1636054292 >> v2:172.21.15.134:3300/0 conn(0x7f0ca00bf720 0x7f0ca00bfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:22:57.658 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9f7fe700 1 --2- 172.21.15.160:0/1636054292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca00c2070 0x7f0ca01514b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0ca00bfff0 tx=0x7f0c94006eb0).ready entity=mon.2 client_cookie=bc679a1b79d16ce5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:57.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9effd700 1 -- 172.21.15.160:0/1636054292 <== mon.2 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940098a0 con 0x7f0ca00c2070 2020-11-20T12:22:57.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9effd700 1 -- 172.21.15.160:0/1636054292 <== mon.2 v2:172.21.15.160:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94009a00 con 0x7f0ca00c2070 2020-11-20T12:22:57.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.650+0000 7f0c9effd700 1 -- 172.21.15.160:0/1636054292 <== mon.2 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94009d80 con 0x7f0ca00c2070 2020-11-20T12:22:57.659 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1636054292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca00c2070 msgr2=0x7f0ca01514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1636054292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca00c2070 0x7f0ca01514b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f0ca00bfff0 tx=0x7f0c94006eb0).stop 2020-11-20T12:22:57.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1636054292 shutdown_connections 2020-11-20T12:22:57.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1636054292 >> v2:172.21.15.134:3300/0 conn(0x7f0ca00bf720 0x7f0ca00bfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.660 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1636054292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca00c2070 0x7f0ca01514b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1636054292 >> 172.21.15.160:0/1636054292 conn(0x7f0ca0060140 msgr2=0x7f0ca0060550 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:57.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1636054292 shutdown_connections 2020-11-20T12:22:57.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.651+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1636054292 wait complete. 2020-11-20T12:22:57.661 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.652+0000 7f0ca50fc700 1 Processor -- start 2020-11-20T12:22:57.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.653+0000 7f0ca50fc700 1 -- start start 2020-11-20T12:22:57.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.653+0000 7f0ca50fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca00bf720 0x7f0ca0156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0ca50fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca01519a0 0x7f0ca0160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.662 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0ca50fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca0164130 0x7f0ca014e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.663 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0ca50fc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0164600 con 0x7f0ca01519a0 2020-11-20T12:22:57.663 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0ca50fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0161090 con 0x7f0ca00bf720 2020-11-20T12:22:57.663 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0ca50fc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01555c0 con 0x7f0ca0164130 2020-11-20T12:22:57.663 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca01519a0 0x7f0ca0160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca00bf720 0x7f0ca0156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0ca48fb700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca0164130 0x7f0ca014e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca00bf720 0x7f0ca0156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.160:52148/0 (socket says 172.21.15.160:52148) 2020-11-20T12:22:57.664 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 -- 172.21.15.160:0/1451251769 learned_addr learned my addr 172.21.15.160:0/1451251769 (peer_addr_for_me v2:172.21.15.160:0/0) 2020-11-20T12:22:57.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 -- 172.21.15.160:0/1451251769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca0164130 msgr2=0x7f0ca014e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.666 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca0164130 0x7f0ca014e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 -- 172.21.15.160:0/1451251769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca01519a0 msgr2=0x7f0ca0160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca01519a0 0x7f0ca0160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.667 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.654+0000 7f0c9ffff700 1 -- 172.21.15.160:0/1451251769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0155860 con 0x7f0ca00bf720 2020-11-20T12:22:57.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.655+0000 7f0c9ffff700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca00bf720 0x7f0ca0156f30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0c9000ef50 tx=0x7f0c90006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:57.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.655+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9000cb10 con 0x7f0ca00bf720 2020-11-20T12:22:57.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.655+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9000cc70 con 0x7f0ca00bf720 2020-11-20T12:22:57.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.655+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900123f0 con 0x7f0ca00bf720 2020-11-20T12:22:57.668 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.655+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca0155b00 con 0x7f0ca00bf720 2020-11-20T12:22:57.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.655+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca0160460 con 0x7f0ca00bf720 2020-11-20T12:22:57.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.656+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca00611e0 con 0x7f0ca00bf720 2020-11-20T12:22:57.669 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.657+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 5) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0c90012760 con 0x7f0ca00bf720 2020-11-20T12:22:57.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.658+0000 7f0c7ffff700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0c78080630 0x7f0c78082af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:22:57.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.658+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 7913+0+0 (secure 0 0 0) 0x7f0c900a3310 con 0x7f0ca00bf720 2020-11-20T12:22:57.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.659+0000 7f0c9f7fe700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0c78080630 0x7f0c78082af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:22:57.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.659+0000 7f0c9f7fe700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0c78080630 0x7f0c78082af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0ca00c24e0 tx=0x7f0c94015000).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:22:57.670 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.661+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0c90077e90 con 0x7f0ca00bf720 2020-11-20T12:22:57.845 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.841+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"} v 0) v1 -- 0x7f0ca0044f60 con 0x7f0ca00bf720 2020-11-20T12:22:57.853 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.849+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0c90077e90 con 0x7f0ca00bf720 2020-11-20T12:22:57.854 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.849+0000 7f0c7ffff700 1 -- 172.21.15.160:0/1451251769 <== mon.1 v2:172.21.15.150:3300/0 8 ==== mon_command_ack([{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}]=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0c9007b4b0 con 0x7f0ca00bf720 2020-11-20T12:22:57.855 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0c78080630 msgr2=0x7f0c78082af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.856 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0c78080630 0x7f0c78082af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0ca00c24e0 tx=0x7f0c94015000).stop 2020-11-20T12:22:57.856 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca00bf720 msgr2=0x7f0ca0156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:22:57.856 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca00bf720 0x7f0ca0156f30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f0c9000ef50 tx=0x7f0c90006df0).stop 2020-11-20T12:22:57.856 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 shutdown_connections 2020-11-20T12:22:57.857 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:6800/21431,v1:172.21.15.150:6801/21431] conn(0x7f0c78080630 0x7f0c78082af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.857 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ca0164130 0x7f0ca014e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.857 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca00bf720 0x7f0ca0156f30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.857 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 --2- 172.21.15.160:0/1451251769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ca01519a0 0x7f0ca0160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:22:57.858 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.852+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 >> 172.21.15.160:0/1451251769 conn(0x7f0ca0060140 msgr2=0x7f0ca00c0400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:22:57.858 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.853+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 shutdown_connections 2020-11-20T12:22:57.858 INFO:teuthology.orchestra.run.smithi160.stderr:2020-11-20T12:22:57.853+0000 7f0ca50fc700 1 -- 172.21.15.160:0/1451251769 wait complete. 2020-11-20T12:22:57.877 INFO:teuthology.misc:Shutting down mds daemons... 2020-11-20T12:22:57.878 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-11-20T12:22:57.879 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:57.932 INFO:tasks.ceph.mds.a:Stopped 2020-11-20T12:22:57.933 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-11-20T12:22:57.933 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:57.943 INFO:tasks.ceph.mds.b:Stopped 2020-11-20T12:22:57.944 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-11-20T12:22:57.944 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:57.953 INFO:tasks.ceph.mds.c:Stopped 2020-11-20T12:22:57.954 INFO:teuthology.misc:Shutting down osd daemons... 2020-11-20T12:22:57.954 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2020-11-20T12:22:57.954 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:57.994 INFO:tasks.ceph.osd.0:Stopped 2020-11-20T12:22:57.994 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2020-11-20T12:22:57.995 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.038 INFO:tasks.ceph.osd.3:Stopped 2020-11-20T12:22:58.038 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2020-11-20T12:22:58.039 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.074 INFO:tasks.ceph.osd.6:Stopped 2020-11-20T12:22:58.075 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2020-11-20T12:22:58.075 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.162 INFO:tasks.ceph.osd.9:Stopped 2020-11-20T12:22:58.163 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2020-11-20T12:22:58.163 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.175 INFO:tasks.ceph.osd.1:Stopped 2020-11-20T12:22:58.176 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2020-11-20T12:22:58.176 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.230 INFO:tasks.ceph.osd.4:Stopped 2020-11-20T12:22:58.230 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2020-11-20T12:22:58.230 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.283 INFO:tasks.ceph.osd.7:Stopped 2020-11-20T12:22:58.284 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2020-11-20T12:22:58.284 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.337 INFO:tasks.ceph.osd.10:Stopped 2020-11-20T12:22:58.338 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2020-11-20T12:22:58.338 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.357 INFO:tasks.ceph.osd.2:Stopped 2020-11-20T12:22:58.358 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2020-11-20T12:22:58.358 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.417 INFO:tasks.ceph.osd.5:Stopped 2020-11-20T12:22:58.417 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2020-11-20T12:22:58.418 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.491 INFO:tasks.ceph.osd.8:Stopped 2020-11-20T12:22:58.506 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2020-11-20T12:22:58.509 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.550 INFO:tasks.ceph.osd.11:Stopped 2020-11-20T12:22:58.550 INFO:teuthology.misc:Shutting down mgr daemons... 2020-11-20T12:22:58.551 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2020-11-20T12:22:58.551 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.645 INFO:tasks.ceph.mgr.x:Stopped 2020-11-20T12:22:58.645 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2020-11-20T12:22:58.646 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.667 INFO:tasks.ceph.mgr.y:Stopped 2020-11-20T12:22:58.668 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2020-11-20T12:22:58.669 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.687 INFO:tasks.ceph.mgr.z:Stopped 2020-11-20T12:22:58.688 INFO:teuthology.misc:Shutting down mon daemons... 2020-11-20T12:22:58.689 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2020-11-20T12:22:58.690 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.728 INFO:tasks.ceph.mon.a:Stopped 2020-11-20T12:22:58.729 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2020-11-20T12:22:58.729 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.743 INFO:tasks.ceph.mon.b:Stopped 2020-11-20T12:22:58.744 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2020-11-20T12:22:58.744 INFO:teuthology.orchestra.run:waiting for 300 2020-11-20T12:22:58.756 INFO:tasks.ceph.mon.c:Stopped 2020-11-20T12:22:58.757 INFO:tasks.ceph:Checking cluster log for badness... 2020-11-20T12:22:58.757 INFO:teuthology.orchestra.run.smithi160:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2020-11-20T12:22:58.858 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:22:58.859 INFO:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2020-11-20T12:22:59.328 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:22:59.329 INFO:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2020-11-20T12:22:59.726 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:22:59.727 INFO:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2020-11-20T12:23:00.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi160.front.sepia.ceph.com 2020-11-20T12:23:00.009 INFO:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2020-11-20T12:23:00.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:23:00.309 INFO:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2020-11-20T12:23:00.651 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:23:02.357 INFO:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2020-11-20T12:23:02.460 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:23:02.460 INFO:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2020-11-20T12:23:02.532 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi150.front.sepia.ceph.com 2020-11-20T12:23:02.533 INFO:teuthology.orchestra.run.smithi150:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2020-11-20T12:23:02.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:23:02.606 INFO:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2020-11-20T12:23:02.823 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:23:02.824 INFO:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-20T12:23:02.926 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:23:02.927 INFO:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2020-11-20T12:23:03.011 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi134.front.sepia.ceph.com 2020-11-20T12:23:03.012 INFO:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2020-11-20T12:23:03.086 INFO:tasks.ceph:Archiving mon data... 2020-11-20T12:23:03.093 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306/data/mon.a.tgz 2020-11-20T12:23:03.094 INFO:teuthology.orchestra.run.smithi160:> mktemp 2020-11-20T12:23:03.155 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.lDVbmVemgo 2020-11-20T12:23:03.156 INFO:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.lDVbmVemgo 2020-11-20T12:23:03.484 INFO:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.lDVbmVemgo 2020-11-20T12:23:03.644 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.lDVbmVemgo is 897KB 2020-11-20T12:23:03.722 INFO:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.lDVbmVemgo 2020-11-20T12:23:03.779 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306/data/mon.b.tgz 2020-11-20T12:23:03.779 INFO:teuthology.orchestra.run.smithi150:> mktemp 2020-11-20T12:23:03.796 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.nyYsTSpJ1R 2020-11-20T12:23:03.797 INFO:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nyYsTSpJ1R 2020-11-20T12:23:04.077 INFO:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.nyYsTSpJ1R 2020-11-20T12:23:04.195 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.nyYsTSpJ1R is 897KB 2020-11-20T12:23:04.317 INFO:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.nyYsTSpJ1R 2020-11-20T12:23:04.335 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306/data/mon.c.tgz 2020-11-20T12:23:04.336 INFO:teuthology.orchestra.run.smithi134:> mktemp 2020-11-20T12:23:04.355 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.iwelGWwPrF 2020-11-20T12:23:04.357 INFO:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iwelGWwPrF 2020-11-20T12:23:04.634 INFO:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.iwelGWwPrF 2020-11-20T12:23:04.719 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.iwelGWwPrF is 882KB 2020-11-20T12:23:04.822 INFO:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.iwelGWwPrF 2020-11-20T12:23:04.836 INFO:tasks.ceph:Cleaning ceph cluster... 2020-11-20T12:23:04.837 INFO:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:23:04.882 INFO:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:23:04.905 INFO:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2020-11-20T12:23:05.033 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2020-11-20T12:23:05.034 INFO:teuthology.orchestra.run.smithi160:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:23:05.070 INFO:teuthology.orchestra.run.smithi150:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:23:05.084 INFO:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2020-11-20T12:23:05.107 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:23:05.127 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:23:05.182 INFO:teuthology.orchestra.run.smithi160.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2020-11-20T12:23:05.202 INFO:tasks.ceph:Archiving crash dumps... 2020-11-20T12:23:05.216 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306/remote/smithi160/crash 2020-11-20T12:23:05.220 INFO:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:23:05.334 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306/remote/smithi150/crash 2020-11-20T12:23:05.337 INFO:teuthology.orchestra.run.smithi150:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:23:05.373 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306/remote/smithi134/crash 2020-11-20T12:23:05.374 INFO:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2020-11-20T12:23:05.408 INFO:tasks.ceph:Shutting down logrotate 2020-11-20T12:23:05.408 INFO:teuthology.orchestra.run.smithi134:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:23:05.450 INFO:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:23:05.452 INFO:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:23:05.597 INFO:teuthology.orchestra.run.smithi134:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:23:05.624 INFO:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:23:05.655 INFO:teuthology.orchestra.run.smithi160:> sudo rm /etc/logrotate.d/ceph-test.conf 2020-11-20T12:23:05.762 INFO:tasks.ceph:Compressing logs... 2020-11-20T12:23:05.763 INFO:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:23:05.768 INFO:teuthology.orchestra.run.smithi150:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:23:05.771 INFO:teuthology.orchestra.run.smithi160:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2020-11-20T12:23:05.780 INFO:tasks.ceph:Archiving logs... 2020-11-20T12:23:05.780 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640306/remote/smithi160/log 2020-11-20T12:23:05.782 INFO:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/log/ceph -- .